Method and apparatus for manipulating content in an interface

ABSTRACT

A machine implemented method includes sensing entities in first and second domains. If a first stimulus is present and an entity is in the first domain, the entity is transferred from first to second domain via a bridge. If a second stimulus is present and an entity is in the second domain, the entity is transferred from second first domain via the bridge. At least some of the first domain is outputted. An apparatus includes a processor that defines first and second domains and a bridge that enables transfer of entities between domains, an entity identifier that identifies entities in the domains, a stimulus identifier that identifies stimuli, and a display that outputs at least some of the first domain. The processor transfers entities from first to second domain responsive to a first stimulus, and transfers entities from second to first domain responsive to a second stimulus.

CROSS-REFERENCE TO RELATED APPLICATION

This application is a continuation of U.S. Pat. Application No.17/144,567, titled “METHOD AND APPARATUS FOR MANIPULATING CONTENT IN ANINTERFACE,” filed Jan. 8, 2021, now U.S. Pat. No. 11,599,200, which is acontinuation of U.S. Pat. Application No. 16/420,642, titled “METHOD ANDAPPARATUS FOR MANIPULATING CONTENT IN AN INTERFACE,” filed on May 23,2019, now U.S. Pat. No. 10,921,898, which is a continuation of U.S. Pat.Application No. 15/614,507, titled “METHOD AND APPARATUS FORMANIPULATING CONTENT IN AN INTERFACE,” filed on Jun. 5, 2017, now U.S.Pat. No. 10,345,915, which is a continuation of U.S. Pat. ApplicationNo. 14/019,175, titled “METHOD AND APPARATUS FOR MANIPULATING CONTENT INAN INTERFACE,” filed on Sep. 5, 2013, now U.S. Pat. No. 9,703,383, allof which are incorporated herein by reference for all purposes.

FIELD OF THE INVENTION

This invention relates to manipulation of content in an interface. Moreparticularly, the invention relates to establishing distinct first andsecond domains of an interface, manipulating entities therein, andmoving entities therebetween.

DESCRIPTION OF RELATED ART

In some interfaces a generally open environment is provided that enablesentities to be stored, arranged, manipulated, etc. within theenvironment. For example, certain graphical user interfaces for PCs,tablets, etc. have a desktop supporting icons that represent programs,files, folders, constructs such as “trash”, etc.

However, such an approach has limits. A single undifferentiated spaceoffers relatively few options for arranging and disposing entitiestherein; to continue the example of a PC desktop, icons either are onthe desktop or not. Also, a single space can rapidly become crowded withentities. Also, where PC desktops and similar approaches typically arethemselves static or nearly so, more dynamic or interactive environmentssuch as might be encountered with virtual or augmented reality systemsmay be less well-suited for static, single-domain approaches. This maybe particularly true for environments wherein multiple users may accessand/or manipulate the environments.

There is a need for a simple, efficient method and apparatus formanipulating and/or storing content within an interface.

BRIEF SUMMARY OF THE INVENTION

The present invention contemplates a variety of systems, apparatus,methods, and paradigms for manipulating content in an interface.

In one embodiment of the present invention, a machine implemented methodis provided that includes identifying the presence of at least oneentity in a first domain and/or a second domain substantially distinctfrom the first domain, the first and second domains each having at leasttwo dimensions, the first and second domains being in communication viaa bridge so as to enable transfer of the entity between the first andsecond domains therewith. The method includes identifying the presenceof a first stimulus, and identifying the presence of a second stimulus.If the first stimulus is present and the entity is present in the firstdomain, the entity is transferred from the first domain to the seconddomain. If the second stimulus is present and the entity is present inthe second domain, the entity is transferred from the second domain tothe first domain. The method includes generating output data suitablefor outputting at least a portion of the first domain.

At least a portion of the second domain may be coincident with at leasta portion of the first domain in the at least two dimensions, with thefirst and second domains being distinct in at least a dimension otherthan the at least two dimensions.

At least a portion of the second domain may be substantially adjacent atleast a portion of the first domain.

The first and second domains may be distinct in the at least twodimensions thereof.

The bridge may be substantially fixed with respect to the visual fieldof a viewer. The bridge may be substantially fixed with respect to thecenter of mass of a viewer. The bridge may be disposed substantiallyoutside the visual field of a viewer. The bridge may be disposedsubstantially at the edge of the visual field of a viewer. The bridgemay be disposed within the visual field of a viewer.

The bridge may be movable. The bridge may be movable responsive to aviewer command. The bridge may be biased toward at least one of a restposition therefor and a rest orientation therefor. The rest position maybe substantially outside the visual field of a viewer. The rest positionmay be substantially at the edge of a visual field of a viewer. The restposition may be within the visual field of a viewer.

The content of the second domain may not be resolved. The content of thesecond domain may be selectively resolved, such that the content isresolved to at least one first viewer but is not resolved to at leastone second viewer. The content of the second domain may be selectivelyresolved, such that the content is resolved with a first configurationto at least one first viewer and with a second configuration to at leastone second viewer.

The entity may be a graphical icon, a virtual object, an augmentation,executable instructions, stored data, a control, and/or a menu.

The first and second domains may each include three dimensions. Thefirst domain may be a virtual reality environment and/or an augmentedreality environment. The second domain may be a virtual realityenvironment and/or an augmented reality environment.

The bridge may be visible. The bridge may be substantially invisible.

The first stimulus may include a user manipulation. The first stimulusmay include a hand posture, a hand gesture, a stylus posture, and/or astylus gesture. The first stimulus may include an end-effector engagingthe entity in the first domain and moving the entity from the firstdomain through the bridge to the second domain while the end-effector isengaged with the entity. The first stimulus may include engaging theentity in the first domain and executing a hand posture, a hand gesture,a stylus posture, and/or a stylus gesture in the first domain. The firststimulus may include passing an end-effector through the bridge. Thefirst stimulus may include passing the end-effector through the bridgesubstantially along a first path, wherein passing the end-effectorthrough the bridge other than substantially along a first path does notconstitute execution of the first stimulus. The first stimulus mayinclude passing the end-effector through the bridge while executing onea first posture with the end-effector, wherein passing the end-effectorthrough the bridge other than while executing a first posture does notconstitute execution of the first stimulus. The first stimulus mayinclude passing the end-effector through the bridge while executing afirst gesture with the end-effector, wherein passing the end-effectorthrough the bridge other than while executing a first gesture does notconstitute execution of the first stimulus.

The second stimulus may include a user manipulation. The second stimulusmay include a hand posture, a hand gesture, a stylus posture, and/or astylus gesture in the first domain. The second stimulus may include anend-effector engaging the entity in the second domain and moving theentity from the second domain through the bridge to the first domainwhile the end-effector is engaged with the entity. The second stimulusmay include engaging the entity in the second domain and executing ahand posture, a hand gesture, a stylus posture, and/or a stylus gesturein the second domain. The second stimulus may include passing anend-effector through the bridge. The second stimulus may include passingthe end-effector through the bridge substantially along a second path,wherein passing the end-effector through the bridge other thansubstantially along a second path does not constitute execution of thesecond stimulus. The second stimulus may include passing theend-effector through the bridge while executing a second posture withthe end-effector, wherein passing the end-effector through the bridgeother than while executing a second postures does not constituteexecution of the second stimulus. The second stimulus may includepassing the end-effector through the bridge while executing a secondgesture with the end-effector, wherein passing the end-effector throughthe bridge other than while executing a second gesture does notconstitute execution of the second stimulus.

The first and second stimuli may be substantially similar.

The bridge may substantially correspond with at least a portion of theouter edge of the visual field of a viewer. The bridge may substantiallycorrespond with substantially all of the outer edge of the visual fieldof a viewer.

The first domain may substantially correspond with the visual field of auser, and the second domain may be disposed outward from the firstdomain.

The method may include outputting some or all of the first domainthrough at least one window. The method may include outputting some orall of the first domain through stereo windows. The window maysubstantially correspond to the visual field of a viewer.

The method may include outputting some or all of the first domainthrough stereo windows, the stereo windows substantially correspondingto the visual field of a viewer, wherein: the first and second domainseach include three spatial dimensions, substantially all of the seconddomain is coincident with at least a portion of the first domain inthree spatial dimensions, the first and second domains are distinct in anon-spatial dimension, the bridge substantially corresponds with atleast a portion of the outer edge of a visual field of a viewer suchthat the second domain is substantially outward of the outer edge of thevisual field with the bridge being substantially fixed with respect tothe visual field, the bridge is movable with respect to the firstdomain, the second domain is substantially fixed with respect to thebridge, the content of the second domain is not resolved, the firststimulus includes an end-effector engaging the entity in the firstdomain and moving the entity from the first domain through the bridge tothe second domain while the end-effector is engaged with the entity, andthe second stimulus includes an end-effector engaging the entity in thesecond domain and moving the entity from the second domain through thebridge to the first domain while the end-effector is engaged with theentity.

The method may include outputting some or all of the first domainthrough stereo windows, the stereo windows substantially correspondingto the visual field of a viewer, wherein: the first and second domainseach include three spatial dimensions, at least a portion of the seconddomain is adjacent at least a portion of the first domain, the bridgesubstantially corresponds with at least a portion of the outer edge ofthe visual field of a viewer such that the second domain issubstantially outward of the outer edge of the visual field with thebridge being substantially fixed with respect to the visual field, thebridge is movable with respect to the first domain, the second domain issubstantially fixed with respect to the bridge, the content of thesecond domain is not resolved, the first stimulus includes anend-effector engaging the entity in the first domain and moving theentity from the first domain through the bridge to the second domainwhile the end-effector is engaged with the entity, and the secondstimulus includes an end-effector engaging the entity in the seconddomain and moving the entity from the second domain through the bridgeto the first domain while the end-effector is engaged with the entity.

The second domain may also be in communication with a beta second domainvia the bridge so as to enable transfer of the entity between the seconddomain and the beta second domain therewith, with the method furtherincluding identifying the presence of third stimulus and, if the thirdstimulus is present and the entity is present in the second domain,transferring the entity from the second domain to the beta seconddomain.

In another embodiment of the present invention, a machine implementedmethod is provided that includes defining in a processor first andsecond domains, the first and second domains each including at least twodimensions, the second domain being substantially distinct from thefirst domain. The method includes defining in the processor a bridgebetween the first and second domains so as to enable transfer of anentity between the first and second domains, and defining in theprocessor at least one entity disposed in at least one of the first andsecond domains. The method also includes defining in the processor afirst stimulus, defining in the processor a first response to the firststimulus with the first response including transferring the entity fromthe first domain to the second domain, defining in the processor asecond stimulus, and defining in the processor a second response to thesecond stimulus with the second response comprising transferring theentity from the second domain to the first domain. The method furtherincludes instantiating in the processor executable instructions adaptedto identify the presence of the entity in the first domain,instantiating in the processor executable instructions adapted toidentify the presence of the entity in the second domain, instantiatingin the processor executable instructions adapted to identify thepresence of the first stimulus, and instantiating in the processorexecutable instructions adapted to identify the presence of the secondstimulus. The method also includes instantiating in the processorexecutable instructions adapted execute the first response,instantiating in the processor executable instructions adapted toexecute the second response, and instantiating in the processorexecutable instructions adapted to output at least a portion of thefirst domain.

The method may include defining the first and second domains in theprocessor such that at least a portion of the second domain iscoincident with at least a portion of the first domain in at least twodimensions, and such that the first and second domains are distinct inat least a dimension other than the two dimensions. The method mayinclude defining the first and second domains in the processor such thatat least a portion of the second domain is substantially adjacent atleast a portion of the first domain.

The method may include instantiating in the processor executableinstructions adapted to enable motion of the bridge. The method mayinclude instantiating in the processor executable instructions adaptedto enable motion of the bridge responsive to a viewer command. Themethod may include instantiating in the processor executableinstructions adapted to bias the continuity toward a rest positiontherefor.

The method may include instantiating in the processor executableinstructions adapted to selectively resolve the content of the seconddomain, such that the content is resolved to at least one first viewerbut is not resolved to at least one second viewer. The method mayinclude instantiating in the processor executable instructions adaptedto selectively resolve the content of the second domain, such that thecontent is resolved with a first configuration to at least one firstviewer and with a second configuration to at least one second viewer.

The method may include defining at least one output window, andinstantiating in the processor executable instructions adapted to outputat least the portion of the first domain through the at least onewindow. The method may include defining stereo output windows, andinstantiating in the processor executable instructions adapted to outputat least the portion of the first domain through the stereo windows.

In another embodiment of the present invention, a machine implementedmethod is provided that includes identifying the presence of at leastone entity in at least one of a first domain and a second domainsubstantially distinct from the first domain, the first and seconddomains each including at least two dimensions, the first and seconddomains being in communication via a bridge so as to enable transfer ofthe entity between the first and second domains therewith. The methodincludes identifying the presence of at least one of: a stimulusinitiating in the first domain and terminating in the second domain, astimulus initiating in the second domain and terminating in the firstdomain, a stimulus substantially entirely in the first domain, and astimulus substantially entirely in the second domain. If the stimulus ispresent initiating in the first domain and terminating in the seconddomain, a first response is executed. If the stimulus is presentinitiating in the second domain and terminating in the first domain, asecond response is executed. If the stimulus is present substantiallyentirely in the first domain, a third response is executed. If thestimulus is present substantially entirely in the second domain, afourth response is executed. The method includes outputting at least aportion of the first domain.

In another embodiment of the present invention, a machine implementedmethod is provided that includes identifying the presence of at leastone of: a stimulus initiating in a first domain and terminating in asecond domain substantially distinct from the first domain, the firstand second domains each comprising at least two dimensions, the seconddomain being substantially distinct from the first domain, the first andsecond domains being in communication via a bridge so as to enabletransfer of the entity between the first and second domains therewith;the stimulus initiating in the second domain and terminating in thefirst domain; the stimulus substantially entirely in the first domain;and the stimulus substantially entirely in the second domain. If thestimulus is present initiating in the first domain and terminating inthe second domain, a first response is executed. If the stimulus ispresent initiating in the second domain and terminating in the firstdomain, a second response is executed. If the stimulus is presentsubstantially entirely in the first domain, a third response isexecuted. If the stimulus is present substantially entirely in thesecond domain, a fourth response is executed. The method includesoutputting at least a portion of the first domain.

The method may include identifying the presence of at least one entityin at least one of the first domain and the second domain.

The first response may include transferring the entity from the firstdomain to the second domain, with the second response includingtransferring the entity from the second domain to the first domain.

In another embodiment of the present invention, an apparatus is providedthat includes a processor, the processor being adapted to define a firstdomain and a second domain substantially distinct from the first domain,the first and second domains each comprising at least two dimensions,the processor further being adapted to define a bridge such that thefirst and second domains are in communication via the bridge so as toenable a transfer of an entity between the first and second domainstherewith. The apparatus includes an entity identifier in communicationwith the processor, the entity identifier being adapted to identify thepresence of the entity in the first domain and the second domain. Theapparatus includes a stimulus identifier in communication with theprocessor, the stimulus identifier being adapted to identify a firststimulus and a second stimulus. The apparatus includes at least onedisplay in communication with the processor, the display being adaptedto output at least a portion of the first domain. The processor isfurther adapted to transfer the entity from the first domain to thesecond domain in response to the first stimulus, and to transfer theentity from the second domain to the first domain in response to thesecond stimulus.

The entity identifier may include executable instructions disposed onthe processor. The entity identifier may include a physical componentdistinct from the processor.

The display may include a stereo display.

The apparatus may include a body, with the processor, the entityidentifier, the stimulus identifier, and the display being incommunication with the body. The body may be adapted to be worn on auser’s head. The display may be disposed on the body such that when thebody is worn on the head, the display is disposed proximate andsubstantially in front of at least one eye of the head.

In another embodiment of the present invention, a machine implementedmethod is provided that includes means for identifying the presence ofat least one entity in at least one of a first domain and a seconddomain substantially distinct from the first domain, the first andsecond domains each comprising at least two dimensions, the first andsecond domains being in communication via a bridge so as to enabletransfer of the entity between the first and second domains therewith.The apparatus includes means for identifying a presence of a firststimulus, and means for identifying a presence of a second stimulus. Theapparatus also includes means for transferring the entity from the firstdomain to the second domain if the first stimulus is present and theentity is present in the first domain, and means for transferring theentity from the second domain to the first domain if the second stimulusis present and the entity is present in the second domain. The apparatusfurther includes means for outputting at least a portion of the firstdomain.

BRIEF DESCRIPTION OF THE SEVERAL VIEWS OF THE DRAWINGS

Like reference numbers generally indicate corresponding elements in thefigures.

FIG. 1 shows an overhead schematic view of an example arrangement of afirst domain according to the present invention.

FIG. 2 shows an overhead schematic view of an example arrangement offirst and second domains with a bridge therebetween according to thepresent invention.

FIG. 3A shows an overhead schematic view of an example arrangement offirst and second domains with a bridge therebetween and the domainsdistinct in a third dimension according to the present invention.

FIG. 3B shows a perspective schematic view of an example arrangement offirst and second domains with a bridge therebetween and the domainsdistinct in a third dimension according to the present invention.

FIG. 3C shows an overhead wireframe view of an example arrangement offirst and second domains with a bridge therebetween according to thepresent invention.

FIG. 3D shows a perspective wireframe view of an example arrangement offirst and second domains with a bridge therebetween according to thepresent invention.

FIG. 4 shows an overhead schematic view of an example arrangement of afirst and second domain with a bridge therebetween according to thepresent invention, the bridge being disposed within the first domain.

FIG. 5A shows a perspective view of an example arrangement of a firstand second domain with a bridge therebetween, initiating transferring anentity from the second domain according to the present invention.

FIG. 5B shows a perspective view of an example arrangement of a firstand second domain with a bridge therebetween, continuing transferring anentity from the second domain according to the present invention.

FIG. 5C shows a perspective view of an example arrangement of a firstand second domain with a bridge therebetween, further continuingtransferring an entity from the second domain according to the presentinvention.

FIG. 5D shows a perspective view of an example arrangement of a firstand second domain with a bridge therebetween, completing transferring anentity from the second domain according to the present invention.

FIG. 6A shows an overhead view of an example arrangement of a first andsecond domain with a bridge therebetween, initiating transferring anentity from the second domain according to the present invention.

FIG. 6B shows an overhead view of an example arrangement of a first andsecond domain with a bridge therebetween, continuing transferring anentity from the second domain according to the present invention.

FIG. 6C shows an overhead view of an example arrangement of a first andsecond domain with a bridge therebetween, further continuingtransferring an entity from the second domain according to the presentinvention.

FIG. 6D shows an overhead view of an example arrangement of a first andsecond domain with a bridge therebetween, completing transferring anentity from the second domain according to the present invention.

FIG. 7A shows a perspective view of an example arrangement of a firstand second domain with a bridge therebetween, initiating transferring anentity from the second domain according to the present invention.

FIG. 7B shows a perspective view of an example arrangement of a firstand second domain with a bridge therebetween, continuing transferring anentity from the second domain according to the present invention.

FIG. 7C shows a perspective view of an example arrangement of a firstand second domain with a bridge therebetween, further continuingtransferring an entity from the second domain according to the presentinvention.

FIG. 7D shows a perspective view of an example arrangement of a firstand second domain with a bridge therebetween, completing transferring anentity from the second domain according to the present invention.

FIG. 8A shows a perspective view of an example arrangement of a firstand second domain with a bridge therebetween, initiating transferring anentity into the second domain according to the present invention.

FIG. 8B shows a perspective view of an example arrangement of a firstand second domain with a bridge therebetween, continuing transferring anentity into the second domain according to the present invention.

FIG. 8C shows a perspective view of an example arrangement of a firstand second domain with a bridge therebetween, further continuingtransferring an entity into the second domain according to the presentinvention.

FIG. 8D shows a perspective view of an example arrangement of a firstand second domain with a bridge therebetween, still continuingtransferring an entity into the second domain according to the presentinvention.

FIG. 8E shows a perspective view of an example arrangement of a firstand second domain with a bridge therebetween, completing transferring anentity into the second domain according to the present invention.

FIG. 9 shows an overhead schematic view of an example arrangement of afirst domain and two second domains according to the present invention.

FIG. 10 shows an overhead schematic view of an example arrangement of afirst domain substantially corresponding to a visual field and a seconddomain disposed therein, according to the present invention.

FIG. 11 shows an overhead schematic view of an example arrangement of afirst domain substantially unbounded and a second domain disposedtherein, according to the present invention.

FIG. 12 shows an overhead schematic view of an example arrangement of afirst domain with a second domain substantially outside a visual field,according to the present invention.

FIG. 13 shows an overhead schematic view of an example arrangement of afirst domain with two second domains and bridges extending a lengththereof, according to the present invention.

FIG. 14 shows an overhead schematic view of an example arrangement of afirst domain and a second domain substantially behind a viewer,according to the present invention.

FIG. 15 shows an overhead schematic view of an example arrangement oftwo viewers, as viewable by one viewer according to the presentinvention.

FIG. 16 shows an overhead schematic view of an example arrangement oftwo viewers, as viewable by another viewer according to the presentinvention.

FIG. 17 shows an overhead schematic view of another example arrangementof two viewers, as viewable by one viewer according to the presentinvention.

FIG. 18 shows an overhead schematic view of another example arrangementof two viewers, as viewable by another viewer according to the presentinvention.

FIG. 19 shows a schematic view of visual fields of a viewer.

FIG. 20A shows an overhead schematic view of an example arrangement of afirst and second domain with a bridge therebetween according to thepresent invention, relative to a stationary mark.

FIG. 20B shows an overhead schematic view of an example arrangement of afirst and second domain with a bridge therebetween according to thepresent invention, with translation relative to a stationary mark.

FIG. 20C shows an overhead schematic view of an example arrangement of afirst and second domain with a bridge therebetween according to thepresent invention, with rotation relative to a stationary mark.

FIG. 20D shows an overhead schematic view of an example arrangement of afirst and second domain with a bridge therebetween according to thepresent invention, with another translation relative to a stationarymark.

FIG. 20E shows an overhead schematic view of an example arrangement of afirst and second domain with a bridge therebetween according to thepresent invention, with another rotation relative to a stationary mark.

FIG. 21 shows an overhead schematic view of an example arrangement oftwo viewers, each with second domains according to the presentinvention.

FIG. 22 shows an overhead schematic view of an example arrangement oftwo viewers, one viewer being rotated, each with second domainsaccording to the present invention.

FIG. 23 shows an overhead schematic view of an example arrangement oftwo viewers, each with second domains according to the presentinvention.

FIG. 24 shows an overhead schematic view of an example arrangement oftwo viewers, one viewer being rotated, each with second domainsaccording to the present invention.

FIG. 25 shows an overhead schematic view of an example arrangement oftwo viewers, each with second domains according to the presentinvention.

FIG. 26 shows an overhead schematic view of an example arrangement oftwo viewers, one viewer being rotated, each with second domainsaccording to the present invention.

FIG. 27 shows a window outputting a portion of a first domain accordingto the present invention.

FIG. 28 shows stereo windows outputting portions of a first domainaccording to the present invention.

FIG. 29 shows an example method for transferring entities between firstand second domains according to the present invention.

FIG. 30 shows another example method for transferring entities betweenfirst and second domains according to the present invention.

FIG. 31 shows an example method for transferring entities between firstand two second domains according to the present invention.

FIG. 32 shows an example method for implementing steps according to thepresent invention onto a processor.

FIG. 33 shows an example apparatus according to the present invention inschematic form.

FIG. 34 shows another example apparatus according to the presentinvention in schematic form, having elements thereof instantiated asexecutable instructions.

FIG. 35 shows an example apparatus according to the present inventionarranged as a head mounted display, in perspective view.

FIG. 36 shows an example method for transferring entities between firstand second domains according to the present invention.

FIG. 37 shows an example method for implementing the steps according tothe present invention onto a processor.

DETAILED DESCRIPTION OF THE INVENTION

Referring to FIG. 1 , an example arrangement of a first domain accordingto the present invention is shown therein in an overhead schematic form.

As may be seen, a viewer 102 is disposed within FIG. 1 . Although theviewer 102 is not necessarily part of the present invention, as thepresent invention relates at least in part to methods and apparatusesfor interfacing between a user and a computer system, e.g. using agraphical or visual approach, the presence of a viewer may beilluminating. However, it is emphasized that the present invention neednot necessarily be defined or otherwise arranged with respect to eithera viewer, nor is a viewer necessarily required to be present.

In addition, as may be seen in FIG. 1 a first domain 104 is showntherein. The first domain 104 is a logical construct in which entitiesmay be present, moved to, moved from, etc. The present invention is notparticularly limited with regard to the entities that may beaccommodated by the first domain 104.

For at least some embodiments, it may be useful to partly or completelyoverlay the first domain 104 onto a physical space, virtual space, etc.,e.g. such that some or all of the first domain 104 is spatiallycoincident with some or all of a physical environment. However, such anarrangement is an example only, and it is emphasized that the firstdomain 104 is a logical construct, and the distinction between whetheran entity is in the first domain 104 or not is a logical distinctionthat does not necessarily correspond to position in space (or toposition in space alone). For example, a physical entity may be disposedat a physical location in space that is spatially coincident with thefirst domain 104 without necessarily being logically considered to be inthe first domain 104.

Thus, although the first domain 104 may be referred to herein forsimplicity as a “place”, a “space”, a “region”, etc., it should beunderstood that the first domain 104 does not necessarily encompass aphysical environment or portion thereof, physical objects, anyparticular location or parcel of physical space, etc.

As shown in FIG. 1 , the first domain 104 is configured so as toapproximately correspond with an area of an environment that would bewithin the visual field of the viewer 102 shown therein. The edges ofthe first domain 104 thus correspond approximately with the edges of theviewer’s visual field. However, this is an example only; the presentinvention is not limited to a first domain 104 that is defined in termsof a field of view, and other arrangements may be equally suitable. Thearrangement of a first domain 104 with regard to a human visual fieldand other options for the first domain 104 will be addressed at greaterlength below. In addition, it is noted that a relatively simple map of ahuman visual field is considered with respect to FIG. 1 , for the sakeof simplicity and clarity of illustration. In practice a human visualfield may be more complex, broader, non-uniform, etc.

Turning to FIG. 2 , an arrangement is shown with both a first domain 204and a second domain 206 distinct from the first domain. As shown, thefirst domain 204 is configured so as to approximately correspond with anarea of an environment that would be within the visual field of a viewer202 as shown therein. The second domain 206 is shown to represent aportion of an environment other than the first domain 204; that is, asshown the first and second domains 204 and 206 together encompasssubstantially an entire environment surrounding a viewer 202. However,such an arrangement is not required; the first and second domains 204and 206 will not necessarily encompass an entire environment. Likewise,the second domain 206 is not required to be larger than the first domain204 as shown in example FIG. 2 , nor is the second domain 206 requiredto be adjacent to the first domain 204, etc.

As with the first domain (as described above with regard to FIG. 1 ),the second domain 206 is a logical construct. Entities may be present inthe second domain 206, moved thereto, moved therefrom, etc., and thepresent invention is not particularly limited with regard to theentities that may be accommodated by the second domain 206. Although forat least some embodiments it may be useful to partly or completelyoverlay the second domain 206 onto a physical space, virtual space,etc., the distinction between whether an entity is in the second domain206 or not is a logical distinction that does not necessarily correspondto position in space (or to position in space alone).

To use an alternative description, the first and second domains 204 and206 may fairly be considered to be statuses. That is, whether an entityis in the first domain 204 or not, or in the second domain 206 or not,is not necessarily a matter of the entity’s position. Likewise, thefirst and second entities 204 and 206 are not required to be defined interms of space or position. The first and/or second domains 204 and 206may be defined spatially for at least some embodiments, and the firstand/or second domains 204 and 206 may for clarity be depicted at somepoints herein as spaces (for example in FIG. 2 ), however, neither thefirst domain 204 nor the second domain 206 necessarily will be definedspatially for any particular embodiment.

Still with regard to FIG. 2 , a bridge 208 between the first domain 204and the second domain 206 is shown therein. The bridge 208 serves as alink between the first and second domains, such that entities may bemoved between the first and second domains 204 and 206. As the first andsecond domains 204 and 206 are logical constructs, so also is the bridge208 therebetween a logical construct. While the bridge 208 may beconsidered under at least some circumstances to be similar to an actualphysical bridge, a tunnel, a gateway, etc. the bridge 208 in the presentinvention is not limited by such physical metaphors, so long as thebridge 208 serves to transfer entities between the first and seconddomains 204 and 206.

Entities are transferred across the bridge 208, that is, from the firstdomain 204 to the second domain 206 or vice versa, through the use ofstimuli. Typically a first stimulus transfers an entity in the firstdomain 204 to the second domain 206, while a second stimulus transfersan entity in the second domain 206 to the first domain 204. Stimuli arediscussed in greater detail below.

The rules governing the first and second domains 204 and 206 and thebehavior of entities therein are not necessarily identical. For example,in a virtual reality or augmented reality system virtual/augmentedentities in the first domain 204 may be resolved (that is, such entitiesmay be rendered visibly as graphical objects), while entities in thesecond domain 206 are not resolved. Thus, transferring an entity fromthe second domain 206 to the first domain 204 may entail a change invisibility; from the standpoint of someone viewing the environment, anentity drawn from the second domain 206 into the first domain 204 mightseem to have appeared out of nowhere.

The first domain 204, second domain 206, and bridge 208 may or may notbe visible or otherwise sensible. For illustration purposes in FIG. 2(and elsewhere herein) lines of demarcation are shown between the firstand second domains 204 and 206, and the bridge 208 is shown as a visibleoutline. A first domain 204, second domain 206, and/or bridge 208 may bemade visible in numerous fashions, for example (e.g. within avirtual/augmented reality environment) using lines or other markers,differences in coloring, textual or graphical markings, etc. A firstdomain 204, second domain 206, and/or bridge 208 also may be madesensible without necessarily being visible, for example by associatingsounds, haptic feedback, etc. thereto, to presence therein, to usethereof, etc.

As has been described, the first and second domains 204 and 206 arelogical constructs, and do not necessarily correspond to physicalspaces. However, correspondence of the first and second domains 204 and206 to physical spaces also is not prohibited. For example, asillustrated in FIG. 2 the second domain 206 is substantially adjacent tothe first domain 204. Thus, in the arrangement of FIG. 2 the first andsecond domains 204 and 206 are distinguished from one another asseparate but adjacent areas in space.

However, other arrangements may be equally suitable. One examplealternate arrangement is shown in FIG. 3A and FIG. 3B.

In FIG. 3A, a viewer 302A, first and second domains 304A and 306A, and abridge 308A connecting the first domain 304A to the second domain 306Aare shown in an overhead schematic view. Although the second domain 306Ais illustrated extending inward from the edge of the first domain 304Atoward the center thereof, rather than extending outward, thearrangement is otherwise at least generally similar to that of FIG. 2 .

However, FIG. 3B shows an arrangement similar to that in FIG. 3A butfrom a perspective view, from a point behind, to the right, and above.Again, a viewer 302B, first and second domains 304B and 306B, and abridge 308B connecting the first domain 304B to the second domain 306Bare shown. As in FIG. 3A, in FIG. 3B the second domain 306B isillustrated extending inward from the edge of the first domain 304Btoward the center thereof. However, as may also be seen in FIG. 3B, thesecond domain 306B is inclined upward relative to the first domain 304B,rather than being in a plane with the first domain 304B. Thus, althoughboth the first and second domains 304B and 306B are themselves bothtwo-dimensional, and overlap or coincide if considered only in twodimensions, the first and second domains 304B and 306B are distinct fromone another in another dimension, specifically the third (z) dimensionas shown.

Although as shown in FIG. 3B, the first and second domains 304B and 306Bare distinct from one another in a spatial dimension, other dimensionalarrangements may be equally suitable. As previously described, the firstand second domains 304B and 306B are logical constructs; thus, the firstand second domains 304B and 306B may be distinguished through what mightbe considered logical dimensions. For example, rather than utilizing athird spatial dimension, dimensional values may be assigned to the firstand/or second domains 304B and 306B that do not necessarily correspondto a physical dimension. Computer processors, for example, can track andutilize such logical or other non-spatial dimensions as readily asspatial dimensions.

Utilizing non-spatial (e.g. logical) dimensions to distinguish a firstdomain from a second domain may be particularly useful, for example, incases where interfaces and/or environments themselves utilize all threehuman-perceptible spatial dimensions. Such an arrangement may beextrapolated from FIG. 3B.

The arrangement in FIG. 3B, aside from the inclination of the seconddomain 306B with respect to the first domain 304B, is generallytwo-dimensional. Such an arrangement is presented therein for the sakeof clarity and simplicity. However, a similar arrangement may beimplemented according to the present invention that is generally threedimensional. An example of such an arrangement is shown in FIG. 3C.

In FIG. 3C, an overhead wireframe view of a three dimensionalarrangement at least somewhat similar to that in FIG. 3A is depicted. InFIG. 3C, a viewer 302C, first and second domains 304C and 306C, and abridge 308C linking the first domain 304C to the second domain 306C areshown. The first domain 304C substantially corresponds to a visual fieldof the viewer 302C, though again such an arrangement is an example only.The second domain 306C is a substantially rectangular volume, extendinginward from the surface of the first domain 304C, again presented as anexample only. It is noted that as shown, the second domain 306C appearsto coincide spatially with at least a portion of the first domain 304C.

In FIG. 3D, a perspective wireframe view of a three dimensionalarrangement at least somewhat similar to that in FIG. 3C is shown. FIG.3D shows a viewer 302D, first and second domains 304D and 306D, and abridge 308D linking the first domain 304D to the second domain 306D. InFIG. 3D, it is again apparent (particularly in combination with FIG. 3C)that the second domain 306D coincide spatially with at least a portionof the first domain 304D.

However, because the first and second domains 304D and 306D are logicalconstructs, and are not necessarily physical spaces, it is stillpossible for the first and second domains 304D and 306D to be distincteven if and where the first and second domains 304D and 306D coincidespatially. For example, a logical dimension may be defined so as todistinguish the first domain 304D from the second domain 306D. That is,for an entity that is in the physical space wherein the first and secondand domains 304D and 306D are spatially coincident, whether the entityin question is in the first domain 304D or the second domain 306D may bedetermined by a value representing a dimension other than theconventional three spatial dimensions. Such an arrangement might utilizea spatial fourth dimension as determined and/or implemented in aprocessor, or such an arrangement might utilize a more abstractdimension such as a simple binary factor, e.g. assigning (for examplewith a processor) a single-bit “0” for the first domain 304D or a “1”for the second domain 306D to the entity in question to differentiatebetween whether the entity is present in the first domain 304D or in thesecond domain 306D. Such a bit might be flipped for an entity passingthrough the bridge 308D. That is, moving an entity into the physicalspace (if any) corresponding to the second domain 306D might only flipsuch a domain dimension bit for that entity to 1 if the entity enteredthe second domain 306D via the bridge 308D.

Other arrangements may be equally suitable.

Thus, for the arrangement shown in FIG. 3D, the second domain 306D maybe distinct from the first domain 304D even though the first and seconddomains 304D and 306D are spatially coincident. Likewise and moreparticularly, a second domain 306D having three spatial dimensions maybe distinct from a first domain 304D having three spatial dimensionseven though the first and second domains 304D and 306D are spatiallycoincident, for example through the use of a fourth logical dimension.

Thus far the first and second domain have been described mostly insofaras the second domain being distinct from the first domain. While theaforementioned distinction between the first and second domains is afeature of the present invention, at this point additional discussion ofthe nature of the first and second domains may be illuminating.

As previously described herein (with reference to FIG. 1 and FIG. 2 ),the first and second domains are logical constructs, and are notnecessarily spaces. Rather, as also previously described (with referenceto FIG. 2 ), the first and second domains represent a potential status.That is, an entity may be considered to be present in the first domain,and/or may be considered to be present in the second domain. While forclarity entities may be addressed as being “in” the first domain or “in”the second domain, this should not be taken to imply that the first orsecond domains are necessarily spaces or positions.

The presence of an entity within the first or second domain may beconsidered in some ways analogous to the presence of a file within afolder on a GUI desktop. While the analogy is inexact, it may beunderstood that a file that is “inside a folder” is not necessarilyphysically located within the folder. In such case, the folder does notrepresent a place, nor even necessarily a defined sector of memory, buta path or identifier that associates the file with the folder. In atleast a somewhat similar fashion, the first and second domains are notnecessarily literal places (though the use of first and/or seconddomains that are literal places is not excluded from the presentinvention), and an entity that is in the first or second domain may notnecessarily be disposed therein in a spatial sense (although again, suchan arrangement is not excluded from the present invention). Rather, anentity that is “in” the first or second domain is associated with thefirst or the second domain, and is subject to rules applicable toentities so associated with the first or second domain as appropriate.

Typically, although not necessarily, the first and second domains of thepresent invention are defined within a virtual reality environmentand/or an augmented reality environment. In such instances, theassociation of an entity with the first or second domains may beimplemented using a processor, including but not limited to a processorcontrolling the virtual or augmented environment. Such implementationmay be purely data-based, e.g simple data flags identifying entities asbeing in the first or second domain, positional data determining whetheran entity is in spatial regions defined as the first or second domains(for embodiments wherein the first and/or second domains are definedspatially), etc.

Although as described it is not required for the first and seconddomains to be defined spatially, in at least some embodiments, includingbut not limited to embodiments utilizing virtual reality and/oraugmented reality environments, the first and/or second domains mayrepresents a spaces, that is, spatial portions of the virtual/augmentedreality environment in question. For arrangements wherein the virtualand/or augmented reality environment corresponds with and/or existswithin a real world physical space, the first and/or second domains maycoincide with and/or represent spatial portions of the real world. Forpurposes of illustration certain functions of the first and seconddomains will now be described with regard to such spatial embodiments ofthe first and second domains.

For embodiments wherein the first and second domains are at leastpartially spatial in nature, the first and second domains may representfirst and second spaces. For example, the first domain may represent onevolumetric three dimensional space, while the second domain representsanother volumetric three dimensional space.

As visible in FIG. 2 and as described previously with reference thereto,if the first and second domains are portions of a space, the first andsecond domains may be distinct from one another by virtue of positionwithin that space. That is, as is visible in FIG. 2 , the first domain204 may represent one part of a space (i.e. as illustrated in FIG. 2 awedge or cone), with the second domain 206 being another part of space.The first and second domains may be adjacent, as is shown for the firstand second domains 204 and 206 in FIG. 2 , but there is no requirementfor the first and second domains to be adjacent. Similarly, although thefirst and second domains may between them occupy the entirety of a spaceas is shown for the first and second domains 204 and 206 in FIG. 2 , itis not required for the first and second domains to together so occupyall of a space. In particular, areas that are neither first domain norsecond domain may exist in some embodiments, and third or additionaldomains may exist. Other arrangements also may be equally suitable.

As visible in FIG. 3A through FIG. 3D and as described previously withreference thereto, if the first and second domains are portions ofspace, the first and second domains also may be distinct from oneanother other than through position within that space. That is, as isvisible in FIG. 3B and FIG. 3D, the second domain 306B or 306D maycoincident with the first domain 304B or 304D within the spatialdimensions of the environment but may be otherwise separated, e.g.through displacement along another dimension. While in terms of physicalreality such a dimension may not tangibly exist, for purposes of a userinterface, virtual environment, augmented reality environment, etc. sucha dimension can be implemented logically, e.g. in a controllingprocessor for a virtual or augmented reality environment.

Other arrangements for distinction between the first and second domainsmay be equally suitable.

However defined, the first and second domains may operate usingdifferent rules, including but not limited to different rules formanipulating and otherwise dealing with entities therein. For example,for an arrangement wherein the first and second domains are definedwithin a processing system, e.g. as part of a virtual or augmentedreality environment, the rules defined for and/or applied to the firstdomain may be different from the rules defined for and/or applied to thesecond domain.

As a more concrete example, consider the matter of whether or not aparticular virtual or augmented reality entity is resolved. In terms ofa virtual or augmented reality environment, an entity is resolved or“rezzed” if that entity is sensibly manifested within thevirtual/augmented environment. For an entity that is resolved, nominallyvisible features will be rendered visibly, audible features will beexpressed audibly, etc. The notion of resolving an entity is significantin virtual/augmented environments at least for the reason that an entitymay potentially exist in the form of data (e.g. data saved on a harddrive in communication with a processor) without being made present aspart of the virtual environment at a given time and place. The data maybe present without the entity representing that data being manifestwithin the environment (i.e. the entity is not visible).

To draw a parallel, a character in a video game may “have” or “becarrying” one or more objects (possibly an arbitrarily large number ofobjects) that are not visibly present within the game at any particularmoment. Weapons might be displayed only when the character equips them,light sources only when the character activates them, keys only when thecharacter must unlock something, etc. The objects in question may existas data, but may not be displayed by the system. When those objects arenot displayed (resolved) by the system, the objects are not simply outof view (i.e. concealed or obstructed from line of sight) but rather donot exist as objects within the environment, instead only existing asdata within the controlling processor.

Returning to the matter of different rules for first and second domains,for some embodiments for example the first and second domains may applydifferent rules to entities therein insofar as resolving those entities.Entities in the first domain might be resolved, while entities in thesecond domain are not resolved. Thus, entities in the first domain wouldbe visible (assuming those entities had a visible component in the firstplace), while entities in the second domain would not be visible.Furthermore, for such an arrangement an entity being moved from thefirst domain to the second domain would initially be visible and thenwould disappear, while an entity being moved from the second domain tothe first domain would initially be invisible and then would appear.

Differences in resolution for the first and second domains, whenpresent, are not limited only to binary arrangements (i.e. resolving ornot resolving an entity). Entities may be selectively resolved. Forexample, some entities may be visible in the first domain but not in thesecond domain, while other entities are visible in the first and seconddomains, etc. Alternately, entities may be resolved in the second domainwhile under some conditions but not under others, etc. Entities also maybe resolved with different sizes, transparencies, frame rates,resolutions (in the sense of the number of pixels, etc.), color schemes,bit depths, dimensionality (e.g. 2D vs. 3D), etc. in the first andsecond domains.

Furthermore, entities may be resolved (or other rules applied)selectively in terms of differing viewers. For example, an entity in thesecond domain might be resolved for a first viewer, but not for a secondviewer. Such an arrangement might be implemented, for example, in avirtual/augmented reality environment that is displayed individually todifferent viewers so as to be tailored thereto. As a more concreteexample, a virtual/augmented reality environment displayed to viewersvia head mounted displays, such that each viewer sees (or at least maysee) the environment differently. Given such an arrangement, aparticular entity could be resolved (thus visible) for one viewer, butnot resolved (thus invisible) for another viewer.

With regard to multiple viewers, it is noted that first and seconddomains may be specific to an individual viewer. That is, for anenvironment supporting multiple viewers, each individual viewer may havea first domain and a second domain specific to that viewer. For firstand second domains that are spatially defined, an entity might be in aposition that is in a second domain for one viewer, while being in afirst domain for another viewer. In such arrangement, typically (thoughnot necessarily) entities may be associated with individual viewers inorder to determine which (if any) first and/or second domain applies toany particular entity.

As already noted with regard to single viewers, here entities areselectively resolved differently for different viewers, differences arenot limited only to resolution and non-resolution. Entities in the firstor second domains may be resolved with different sizes, transparencies,frame rates, resolutions (in the sense of the number of pixels, etc.),color schemes, bit depths, dimensionality (e.g. 2D vs. 3D), etc. foreach different viewer.

Differences in resolution/non-resolution between the first and seconddomains (and more particularly differences in visibility/invisibilitytherebetween), and or for different viewers, are an example only, andthe present invention is not limited thereto. Likewise, differences inrules of operation between first and second domains are not limited onlyto differences that are readily noticeable by viewers. Other differencesmay be equally suitable, in addition to or instead of a difference inresolution.

Similarly to the first and second domains, the bridge also is a logicalconstruct. While the bridge may for at least certain embodiments bedisposed at a spatial location, and/or may link spatial locations (i.e.spatially-defined first and second domains), the bridge is not limitedonly to a spatial definition. Rather, the bridge is in essence a switchmechanism, in that entities may be transferred (“moved”) between thefirst domain and the second domain through use of the bridge.

Typically, though not necessarily, for a bridge that is disposed at somelocation in space, transitions between the first and second domains maybe accomplished by moving an entity to and/or through the space occupiedby the bridge. However, other arrangements may be equally suitable.

For example, as is noted the bridge is not required to be definedspatially. Indeed, the bridge may not have any localized existence atall. The bridge may for example exist purely as executable instructions,such that some stimulus-such as a gesture executed by a viewer-causes anentity to transition between first and second domains.

However, although the first domain, second domain, and bridge are notnecessarily areas or objects, for purposes of explanation it isfrequently useful to describe embodiments thereof that do correspond tophysical locations and/or spaces (e.g. with reference to FIG. 1 throughFIG. 3D and certain other illustrations herein).

Turning now to FIG. 4 , an arrangement is shown therein having viewer402, first and second domains 404 and 406, and a bridge 408 connectingthe first domain 404 to the second domain 406 in an overhead schematicview. Although the second domain 406 is illustrated as a finite pocketdisposed centrally in front of the viewer 402, the arrangement isotherwise at least somewhat similar to that shown in previous figuresherein. It is noted that, assuming the bridge 408 is resolved with agenerally opaque appearance, the viewer 402 may be unable to see thesecond domain 406(even assuming the second domain 406 is resolved andnominally visible) because the bridge 408 may obstruct a line of sightbetween viewer 402 and second domain 406.

Now with reference to FIG. 5A, an arrangement is shown therein that isat least somewhat similar to that in FIG. 4 . FIG. 5A includes a firstdomain 504A and a bridge 508A, and a hand 503A as might belong to aviewer. The bridge 508A is resolved in this example as a ring with anopaque “curtain” central thereto, so that the bridge 508A does notpermit vision therethrough. It is emphasized that such an arrangementfor the bridge 508A is an example only. In addition, no second domain isvisible behind the bridge 508A, but a second domain is presumed to be incommunication with the first domain 504A via the bridge 508A (and suchcommunication will be demonstrated with regard to subsequent images).

Examination of the hand 503A reveals that the hand 503A in a particularposture, specifically in a posture corresponding approximately to oneused to grip an object. As has been noted, typically a first stimulustransfers an entity in the first domain to the second domain, while asecond stimulus transfers an entity in the second domain to the firstdomain. Stimuli may include but are not limited to hand postures andhand gestures; in the arrangement shown in FIG. 5A through FIG. 5D, thegripping posture as shown is utilized as a portion of a gestures thatthat serves as a second stimulus (that is, a stimulus that transfers anentity from the second domain to the first domain).

Moving on to FIG. 5B, a later portion of a second stimulus gesture withthe hand 503B may be seen. The first domain 504B and the bridge 508B arevisibly unchanged from FIG. 5A, but the hand 503B has moved so as toextend partially through the gate 508B into the second domain (notvisible in FIG. 5B).

Turning to FIG. 5C, a still later portion of a second stimulus gesturewith the hand 503C may be seen. Again, the first domain 504C and thebridge 508C are visibly unchanged from FIG. 5B. However, the hand 503Chas moved so as to partially withdraw from the gate 508C and thus alsofrom the second domain (not visible in FIG. 5C). In addition, an entity510C is visible partially withdrawn from the second domain, the exampleentity 510C being illustrated herein in the form of a large hammer.

It is emphasized that the entity 510C is not itself necessary part ofthe present invention. The entity 510C may be affected by, and/orinteract with, the present invention in ways that are illustrative ofthe present invention, and entities therefor are shown and describedherein for that reason. However, the entity 510C is no more an inherentpart of the present invention itself than is the viewer (as previouslydescribed).

Now with reference to FIG. 5D, an arrangement is shown after a secondstimulus gesture with the hand 503D is complete. The first domain 504Dand the bridge 508D are visibly unchanged from FIG. 5C. The hand 503D isfully withdrawn from the bridge 508D, and the entity 510D is nowdisposed within the first domain 504D. In sum, as a result of thegesture shown in the sequence of FIG. 5A through FIG. 5D, the entity hasbeen transferred from the second domain (not illustrated) to the firstdomain.

The gesture shown to represent a seconds stimulus in FIG. 5A throughFIG. 5D is an example only. While a “grab and drag” gesture as in FIG.5A through FIG. 5D may be useful for certain embodiments, for example atleast since such a gesture resembles motions for manipulations ofobjects more generally (i.e. picking something up and moves it), otherpostures, gestures, and other arrangements may be equally suitable.

For example, turning to FIG. 6A, therein another arrangement is shownthat is at least somewhat similar to that in FIG. 5A, though from anoverhead perspective. FIG. 6A includes a first domain 604A, a seconddomain 606A, a bridge 608A, and a hand 603A as might belong to a viewer.As may be seen, the hand 603A is in a particular posture, specificallywith first and second fingers substantially extended and at leastpartially spread, referred to herein as a “peg” posture, adapted toengage an entity for example at the spread fingertips, and/or at a pointtherebetween. In the arrangement shown in FIG. 6A through FIG. 6D, thepeg posture as shown is utilized as a portion of a gesture that thatserves as a second stimulus (a stimulus that transfers an entity fromthe second domain to the first domain).

Moving on to FIG. 6B, a later portion of a second stimulus gesture withthe hand 603B may be seen. The first domain 604B, second domain 606B,and the bridge 508B are visibly unchanged from FIG. 6A, but the hand603B has moved so as to extend at least partially through the gate 608Binto the second domain 606B.

Turning to FIG. 6C, a still later portion of a second stimulus gesturewith the hand 603C may be seen. Again the first domain 604C, seconddomain 606C, and bridge 508C are visibly unchanged from FIG. 6B.However, the hand 603C has moved so as to partially withdraw from thegate 608C and thus also from the second domain 606C. In addition, anentity 610C is visible partially withdrawn from the second domain.

Now with reference to FIG. 6D, an arrangement is shown after a secondstimulus gesture with the hand 603D is complete. The first domain 604D,second domain 606D, and bridge 608D are visibly unchanged from FIG. 6C.The hand 603D is fully withdrawn from the bridge 608D and from thesecond domain 606D, and the entity 610D is now disposed within the firstdomain 604D. In sum, as a result of the gesture shown in the sequence ofFIG. 6A through FIG. 6D, the entity has been transferred from the seconddomain to the first domain.

As shown with regard to the examples in FIG. 5A through FIG. 5D and FIG.6A through FIG. 6D, the gesture utilized as a second stimulus is ofsubstantially consistent configuration. That is, although the hand maymove, fingers do not change position, etc. However, this is an exampleonly, and gestures with varying configurations may be equally suitable.

For example, referring now to FIG. 7A, an arrangement is shown thereinthat is at least somewhat similar to that in FIG. 5A. FIG. 7A includes afirst domain 704A, a second domain 706A, a bridge 708A, and a hand 703Aas might belong to a viewer. The bridge 708A is resolved in this exampleas an open ring permitting vision therethrough. The second domain 706Ais visible through the aperture of the bridge 708A. It is noted that norigid spatial boundaries are illustrated for the first and seconddomains 704A and 706A. As previously noted, the first domain, seconddomain, and bridge are logical constructs, and thus the second domainmay—as in the example illustrated in FIG. 7A—be defined not in spatialterms, but in terms of “on the far side of the bridge”, “having passedthrough the bridge”, etc.

As may be seen the hand 703A is in a particular posture, substantiallyflat and face down with fingers substantially extended and substantiallytogether. In the arrangement shown in FIG. 7A, the flat hand posture asshown is utilized as a portion of a gesture that that serves as a secondstimulus (a stimulus that transfers an entity from the second domain tothe first domain).

Moving on to FIG. 7B, a later portion of a second stimulus gesture withthe hand 703B may be seen. The first domain 704B, second domain 706B,and bridge 708B are visibly unchanged from FIG. 7A, but the hand 703Bhas moved so as to extend partially through the gate 708B into thesecond domain 706B.

Turning to FIG. 7C, a still later portion of a second stimulus gesturewith the hand 703C may be seen. Again, the first domain 704C, seconddomain 706C, and bridge 708C are visibly unchanged from FIG. 7B.However, the hand 703C has changed configuration, the fingers havingmoved so that the hand 703C has assumed a posture correspondingapproximately to one used to grip an object.

In addition, an entity 710C is visible in the grip of the hand 703C. Theentity 710C may resolve, for example, in response to a change inconfiguration of the hand 703C such as that illustrated in FIG. 7C.Although in at least some other examples herein the entities are notresolved until removed from the second domain, such an arrangement isnot required, and an arrangement such as is shown in FIG. 7C is alsoacceptable, wherein entities in the second domain 706C are resolved inresponse to partial or full execution of a stimulus. That is, althoughfor some embodiments resolution may occur upon removal from the seconddomain, other arrangements may be equally suitable.

In addition, it is noted that although the entity 710C is resolved asviewed through the bridge 708C, as previously noted the entity 710C willnot necessarily be resolved from all possible points of view or for allviewers. For example, the entity 710C might be resolved when viewedthrough the bridge 708 while being not resolved (effectively invisible)from other perspectives, e.g. from above, from the sides, from beyondthe bridge 708. In metaphorical terms, the second domain 706C may for atleast certain purposes be considered as similar to an extradimensionalpocket, with the bridge 708C serving as a gateway thereto.

Moving on to FIG. 7D, an arrangement is shown with the entity 710Dremoved from the second domain 706D via the bridge 708D. The firstdomain 704D, second domain 706D, and bridge 708D are visibly unchangedfrom FIG. 7D. In sum, as a result of the gesture shown in the sequenceof FIG. 7A through FIG. 7D, an entity has been transferred from thesecond domain to the first domain.

FIG. 5A through FIG. 5D, FIG. 6A through FIG. 6D, and FIG. 7A throughFIG. 7D all show second stimuli, that is, stimuli for transferring anentity from the second domain to the first domain. Similar firststimuli-stimuli for transferring an entity from the first domain to thesecond domain-may be constructed by reversing the order of the stepsillustrated therein. Moreover, it is emphasized that neither the firstnor the second stimuli is limited to the specific examples illustratedin FIG. 5A through FIG. 5D, FIG. 6A through FIG. 6D, and FIG. 7A throughFIG. 7D, and other arrangements may be equally suitable.

In particular, it is noted that end-effectors other than a hand may beutilized in first and/or second stimuli. For example, for certainembodiments a stylus might be used for gestures and/or postures servingas first and/or second stimuli. Likewise, user manipulations other thangestures and/or postures may be equally suitable, including but notlimited to voice commands, subvocalizations, facial postures and/ormovements, eye orientation and/or movement, input device commands (e.g.typed text, mouse clicks, joystick manipulation, etc.) and brainwavelevels and patterns.

However, for at least some embodiments of the present inventionviewer-executed end-effector manipulations, including but not limitedhand postures and/or gestures, may be useful, at least insofar as handpostures and gestures are frequently natural and intuitive.

It is noted that although the gestures shown in FIG. 5A through FIG. 5D,FIG. 6A through FIG. 6D, and FIG. 7A through FIG. 7D involve passing anend-effector (specifically a viewer’s hand) through the bridge, contactbetween an end-effector and the bridge is not required.

For example, turning to FIG. 8A an arrangement is shown therein with afirst domain 804A, a second domain 806A, a bridge 808A, and a hand 803Aas might belong to a viewer. The bridge 808A is resolved in this exampleas a ring permitting vision therethrough. The second domain 806A isvisible through the aperture of the bridge 808A. Also in FIG. 8A, anentity 810A is present, engaged by the hand 803A. The entity might forexample be a virtual or augmented object, although this is an exampleonly. As may be seen the hand 803A is in a posture correspondingapproximately to one used to grip an object. In the arrangement shown inFIG. 8A, the gripping hand posture as shown is utilized as a portion ofa gesture that that serves as a first stimulus (a stimulus thattransfers an entity from the first domain to the second domain), moreparticularly a first stimulus that does not require a hand 803A or otherend effector to pass through or directly engage the bridge 808A.

Turning to FIG. 8B, a later portion of a first stimulus gesture with thehand 803B may be seen. The first domain 804B, second domain 806B, andbridge 808B are visibly unchanged from FIG. 8A, but the hand 803B hasmoved toward the gate 808B and rotated, moving and rotating the entity810B therewith.

In FIG. 8C, a still later portion of a first stimulus gesture with thehand 803C is shown. The first domain 804C, second domain 806C, andbridge 808C are visibly unchanged from FIG. 8B. However, the hand 803Chas moved further toward the gate 808B and further rotated. In addition,the hand 803C has changed configuration so as to no longer be in agripping posture, instead being in a posture substantially similar toone for releasing a thrown object. The entity 810C has also furthermoved and rotated. In addition, the entity 810C is no longer engagedwith the hand 803C, the hand 803C having disengaged therefrom (i.e.through the change in the configuration of the hand 803C).

Moving to FIG. 8D, a yet later portion of a first stimulus gesture withthe hand 803D is shown. The first domain 804D, second domain 806D, andbridge 808D are visibly unchanged from FIG. 8C. The hand 803D likewiseis unchanged. However, the entity 810D has continued to move in thedirection of the bridge 808D and to rotate. In the example as shown, theentity 810D is partially de-resolved, having passed partially throughthe bridge 808D. As previously noted, such a behavior is an exampleonly, and other arrangements are equally suitable. In an arrangementsuch as a virtual and/or augmented reality system, self-moving behaviorsuch as is shown for the entity 810D in FIG. 8D might be accomplishedfor example by instituting a physics model for some or all entitieswithin the virtual and/or augmented reality system, so that suchentities behave in at least some regards similarly to physical objectsin the physical world (e.g. exhibiting linear and/or angular momentum,etc.). Other arrangements also may be suitable.

Turning to FIG. 8E, an arrangement after the first stimulus by the hand803E is complete is shown. The first domain 804E, second domain 806E,and bridge 808E are visibly unchanged from FIG. 8C. The hand 803Elikewise is unchanged. The entity is no longer visible, having passedthrough the bridge 808E and now being within the second domain 806E. Insum, as a result of the gesture (first stimulus) shown in the sequenceof FIG. 8A through FIG. 8E, an entity has been transferred from thefirst domain to the second domain, and has been so transferred withoutthe hand passing through or otherwise directly interacting with thebridge.

Other arrangements for first and/or second stimuli that do notincorporate contact with, passage through, and/or direct interactionwith a bridge may also be equally suitable. For example, aposture/gesture might be executed within the first domain, e.g. inrelation to an entity in the first domain, with the entity then beingtransferred to the second domain. As a more specific example, touchingan entity (or otherwise identifying the entity) and snapping the fingerson a hand might constitute a stimulus, with the entity then beingtransferred between first and second domains. As has been noted, thebridge may in some embodiments be a set of executable instructions withno resolved appearance or “form” as such, and so may not even exist insuch a way as to enable hands, entities, etc. to pass therethrough orinteract directly therewith. Thus, for at least some embodiments firstand/or second stimuli may necessarily exclude passage through thebridge, and/or direct interaction therewith.

However, for at least some embodiments it may be useful to utilize abridge that is spatially disposed within an environment, for at leastthe reason that contacting a bridge with a hand or other end-effector,and/or passing a hand or other end-effector through a bridge, may beintuitive for transferring entities. Such an arrangement bears at leastsome resemblance to manipulation of familiar physical-world objects,e.g. taking an item out of a bag or a box, etc. Although additionalarrangements having a spatially defined bridge, first domain, and/orsecond domain are presented subsequently to illustrate additionalfeatures of the present invention, a spatially defined bridge, firstdomain, and/or second domain is not required, and the present inventionis not limited thereto.

Turning to FIG. 9 , an example arrangement is shown with a first domain904 and two second domains 906A and 906B, each second domain 906A and906B being distinct from the first domain 904. First and second bridges908A and 908B are shown arranged so as to enable communication betweenthe first domain 904 and the second domains 906A and 906B. As shown, thefirst domain 904 is configured so as to approximately correspond with anarea of an environment that would be within the visual field of a viewer902 as shown therein. The second domains 906A and 906B are shown torepresent a portion of an environment other than the first domain 904.Also, the second domains 906A and 906B are shown to be substantiallyperipheral to the field of view of the viewer 902, though this is anexample only and is not required. In addition, as may be understood fromFIG. 9 , the present invention is not limited only to one second domain906A and 906B; likewise, the present invention is not limited only toone first domain 904.

It is noted the use of multiple second domains 906A and 906B as in FIG.9 may support organization of multiple entities within the seconddomain(s) of a particular embodiment. However, other arrangements fororganizing multiple entities within one or more second domains may beequally suitable. Many approaches for organizing entities, identifyingentities, and distinguishing therebetween are possible within the scopeof the present invention, and the present invention is not particularlylimited with respect thereto.

With reference now to FIG. 10 , an example arrangement is shown with afirst domain 1004 and a second domain 1006 distinct from the firstdomain 1004. A bridge 1008 is shown arranged so as to enablecommunication between the first domain 1004 and the second domain 1006.As shown, the first domain 1004 is configured so as to approximatelycorrespond with an area of an environment that would be within thevisual field of a viewer 1002 as shown therein. The second domain 1006is shown to represent a portion of an environment other than the firstdomain 1004. More particularly, the second domain 1006 is shown to be adiscrete space within the first domain 1004, with the bridge 1008communicating therebetween. (Although as noted previously specificallywith regard to FIG. 3B and FIG. 3D, a second domain may coincidespatially with a first domain, thus the area of the second domain 1006in FIG. 11 is not necessarily excluded from the area of the first domain1004.)

Turning to FIG. 11 , an example arrangement is shown with a first domain1104 and a second domain 1106 distinct from the first domain 1104. Abridge 1108 is shown arranged so as to enable communication between thefirst domain 1104 and the second domain 1106. As shown, the first domain1104 is configured so as to encompass substantially an entireenvironment surrounding a viewer 1102, potentially excepting the area ofthe second domain 1106. (As noted previously specifically with regard toFIG. 3B and FIG. 3D, a second domain may coincide spatially with a firstdomain, thus the area of the second domain 1106 in FIG. 11 is notnecessarily excluded from the area of the first domain 1104.) The seconddomain 1106 is shown to represent a portion of an environment other thanthe first domain 1104, as a discrete space within the first domain 1104.The arrangement of FIG. 11 is at least somewhat similar to that of FIG.10 , except in that the first domain 1104 in FIG. 11 is essentiallyunbounded except for the bridge 1108 and/or second domain 1106.

Referring now to FIG. 12 , an example arrangement is shown with a firstdomain 1204 and a second domain 1206 distinct from the first domain1204. A bridge 1208 is shown arranged so as to enable communicationbetween the first domain 1204 and the second domain 1206. As shown, thefirst domain 1204 is configured so as to approximately correspond withan area of an environment that would be within the visual field of aviewer 1202 as shown therein. The second domain 1206 is shown torepresent a portion of an environment other than the first domain 1204,in particular a region peripheral to the visual field of the viewer 1202and to the right thereto. As may be seen, the arrangement of firstdomains 1204 and/or second domains 1206 is not required to besymmetrical, nor is such arrangement required to be centered withrespect to the field of view of a viewer 1202.

In FIG. 13 an example arrangement is shown with a first domain 1304 andtwo second domains 1306A and 1306B, each second domain 1306A and 1306Bbeing distinct from the first domain 1304. First and second bridges1308A and 1308B are shown arranged so as to enable communication betweenthe first domain 1304 and the second domains 1306A and 1306B. As shown,the first domain 1304 is configured so as to approximately correspondwith an area of an environment that would be within the visual field ofa viewer 1302 as shown therein. The second domains 1306A and 1306B areshown to represent a portion of an environment other than the firstdomain 1304, substantially peripheral to the field of view of the viewer1302.

It is noted that while FIG. 13 may be at least somewhat similar to FIG.9 , the bridges 1308A and 1308B in FIG. 13 are significantly longer thanthe bridges in FIG. 9 , with the bridges 1308A and 1308B in FIG. 13extending substantially the entire illustrated boundary between thefirst domain 1304and the second domains 1306A and 1306B. It is pointedout that bridges are not particularly limited insofar as size and/orconfiguration. In addition, although for simplicity bridges typicallyare illustrated herein as straight lines and/or flat planes, this is anexample only, and other shapes and/or arrangements for bridges may beequally suitable, including but not limited to curved and/or asymmetricbridges.

Turning to FIG. 14 , an example arrangement is shown therein

with a first domain 1404 and a second domain 1406 distinct from thefirst domain 1404. First and second bridges 1408A and 1408B are shownarranged so as to enable communication between the first domain 1204 andthe second domain 1206. As may be seen, the present invention permitsfor at least some embodiments the use of multiple bridges 1408A and1408B for each first domain 1404 and/or each second domain 1406. Inaddition, as also may be seen the second domain 1406 may be arranged soas to be substantially outside the field of view of the viewer 1402.Although not illustrated in FIG. 14 , the first domain 1404 likewise maybe arranged so as to be substantially outside the field of view of theviewer 1402.

At this point additional discussion regarding potential uses of thepresent invention may be illuminating.

There is a notion in animated films that is sometimes referred to as“hammerspace”. The term derives from the ability of characters to reachout of view-behind their back, behind an object obstructing line ofsight, out of the field of view, etc.-to obtain that are then usedon-screen. The classic item so retrieved, and presumably the source ofthe term, is a large hammer that the character then proceeds to use.Implausibly large and/or complex items may be drawn from small or evenapparently non-existent spaces. In practice, the effect on-screen is asif objects were taken from nowhere (sometimes disappearing thereafterjust as inexplicably).

The arrangement of first domain, second domain, and bridge in thepresent invention as shown and described herein is at least somewhatsimilar in general concept to the notion of hammerspace. However, it isemphasized that while the animation version of hammerspace is only anexample of artistic license, the present invention can be implemented soas to actually provide such functionality, in settings including but notlimited to viewer interfaces such as virtual and/or augmented realityenvironments.

For example, again with reference to FIG. 14 , in the examplearrangement shown therein the first domain 1404 generally surrounds theviewer 1402, except for the second domain 1406 disposed generally behindthe viewer 1402. Consider further an example wherein entities in thefirst domain 1404 are resolved while entities in the second domain 1406are not, and wherein first and/or second stimuli for transferringentities between the first and second domains 1404 and 1406 are handgestures that include passing a hand through the bridge 1408A or 1408B.The viewer 1402 could then, in effect, reach behind himself or herself,reach through the bridge 1408A or 1408B, and transfer an object in thesecond domain 1406 into the first domain 1404. For at least some sucharrangements, the effect would be that the viewer 1402 retrieved anentity-for purposes of illustration, perhaps a virtual hammer–from outof nowhere (though in practice the entity was formerly in the seconddomain). The viewer 1402 could likewise transfer the hammer (or anotherentity) into the second domain 1406 from the first domain 1404 with theeffect of disposing of the hammer into nowhere.

It is emphasized that although certain implementations of the presentinvention may exhibit properties that may appear in some instancescounterintuitive insofar as physical-world behavior is concerned, suchas the appearance of drawing items from “nowhere”, the present inventionsupports such functionality in practice, e.g. through the use of firstand second domains with a bridge therebetween as shown and describedherein.

Although for illustrative purposes a hammer is used as an example of anentity that may be transferred between first and second domains, thepresent invention is not limited thereto. A wide range of entities maybe utilized with the present invention, and/or transferred between firstand second domains thereof, including but not limited to virtualobjects, augmentations and/or augmented objects, files and/or otherdata, and applications and/or other executable instructions. Otherentities also may be equally suitable.

The present invention may be implemented in numerous environments, andis not particularly limited with respect thereto. Suitable environmentsmay include, but are not limited to, virtual reality environments,augmented reality environments, and non-immersive graphical userinterfaces. In addition, the functionality of the present invention maybe advantageous for many reasons, including but not limited to thefollowing.

For certain embodiments, the ability to transfer entities between firstand second domains may be useful at least insofar as such abilityprovides for convenient “storage” of entities that even when not in usemay desirably be kept close-at-hand. For example, a person viewingand/or operating within a virtual/augmented reality environment may wishto have various entities easily accessible such as virtual objects,commonly-used applications, etc. While a virtual or augmented realityenvironment may support arranging such objects either in “free space”(floating unsupported) or otherwise resolved and nearby, such anarrangement may result in a cluttered environment. Entities resolved maytend to clutter up available space, obstruct views, distract viewers,etc. By distinguishing first and second domains, and enablingapplication of different rules for handling entities in the first andsecond domains, it becomes possible to store entities unresolved (orotherwise less obtrusive) within a second domain. The second domain maynevertheless be nearby and convenient to the viewer, leaving theentities stored therein readily available for access by the viewer.

In addition, for environments with multiple persons viewing and/orinteracting therewith, advantages may be offered by the presentinvention in terms of privacy and interactivity. In an interactivemulti-user environment, it may be possible for multiple persons tomanipulate a single entity such as a virtual object, a file, etc. Suchcooperative manipulation may be productive or otherwise desirable in atleast some cases. However, the ability of multiple persons to interactwith a single entity also raises issues of permission, e.g. how can“rights” to manipulate a given entity be limited? It may not bedesirable in all cases to simply allow everyone to manipulateeverything.

With first and second domains having the potential for separate rulesfor handling entities, it is possible to broadly group entities usingthe first and second domains, and apply different general rulesregarding privacy, accessibility, security, etc. For example, the firstdomain may establish rules such that entities therein may be accessed,manipulated, etc. by anyone, or at least by anyone within some definedgroup, etc. To continue the example, the second domain then mayestablish rules such that entities therein may be accessed, manipulated,etc. only by a single viewer, only by a group of trusted viewers, etc.Moreover, rules might be instituted for the second domain such that onlya single viewer or a limited group could even see entities in the seconddomain (selectively resolving the entities therein only for thatviewer), reach into or otherwise remove entities from the second domain,etc. The second domain might thus be made a private or at leastsemi-private location.

Such a security arrangement would not necessarily preclude othermeasures, such as passwords, biometric identification, etc. However,arranging entities into groups for/in a first domain and a second domain(and/or additional domains) with different levels of privacy may provideat least a framework for security, and/or a basis on which to implementadditional security features.

As may be suggested by the preceding, for at least some embodiments thesecond domain may be personal. That is, for an environment supportingmultiple viewers interacting therewith, there may be a second domainspecific to each such viewer. With reference now to FIG. 15 and FIG. 16, an arrangement wherein a second domain may be personal and/or specificto an individual is shown therein.

In FIG. 15 , a first viewer 1502 and a second viewer 1512 are presenttherein. The arrangement in FIG. 15 is shown with respect to the firstviewer 1502. That is, what is present in FIG. 15 is what could beperceived by the first viewer 1502 (though with a top-down perspectivefor clarity, rather than necessarily being shown from the literal pointof view of the first viewer 1502). A first domain 1504 substantiallyfills the environment surrounding the first and second viewers 1502 and1512, except for a second domain 1506 disposed behind the first viewer1502. The first domain 1504 and second domain 1506 are in communicationvia bridges 1508A and 1508B. In addition, an entity 1510 is present inthe second domain 1506.

As may be seen, with respect to the first viewer 1502 the second viewer1512 does not have a second domain associated therewith, nor anyentities therein.

Now with reference to FIG. 16 , again a first viewer 1602 and a secondviewer 1612 are present therein. However, the arrangement in FIG. 16 isshown with respect to the second viewer 1612, so that what is present inFIG. 16 is what could be perceived by the second viewer 1612. A firstdomain 1604 substantially fills the environment surrounding the firstand second viewers 1602 and 1612, except for a second domain 1616disposed behind the second viewer 1612. The first domain 1604 and seconddomain 1616 are in communication via bridges 1618A and 1618B. Inaddition, an entity 1620 is present in the second domain 1616.

As may be seen, with respect to the second viewer 1612 the first viewer1602 does not have a second domain associated therewith, nor anyentities therein.

A comparison of FIG. 15 with FIG. 16 reveals an arrangement wherein eachof first and second viewers shares a common first domain, but whereineach such viewer has a second domain specific to the individual viewer,i.e. in FIG. 15 the second domain 1506 (and the entity 1510therein) isvisible to (resolved for) the first viewer 1502 but not for the secondviewer 1512, while in FIG. the second domain 1616 (and the entity 1620therein) is visible to the second viewer 1612 but not the first viewer1602. In both FIG. 15 and FIG. 16 , a viewer therein sees his or her“personal” second domain, but does not see (and may not be permitted toaccess) a second domain associated with another viewer in the samevicinity.

However, as may be seen with respect to FIG. 17 and FIG. 18 , a firstdomain may nevertheless be managed as common to multiple viewers.

In FIG. 17 , a first viewer 1702 and a second viewer 1712 are presenttherein. The arrangement in FIG. 17 is shown with respect to the firstviewer 1702, so that what is present in FIG. 17 is what could beperceived by the first viewer 1702. A first domain 1704 substantiallyfills the environment surrounding the first and second viewers 1702 and1712, except for a second domain 1706 disposed behind the first viewer1702. The first domain 1704 and second domain 1706 are in communicationvia bridges 1708A and 1708B. In addition, an entity 1710 is present inthe first domain 1704. The arrangement is at least somewhat similar tothat in FIG. 15 , except that in FIG. 17 the entity 1710 is in the firstdomain 1704 rather than in the second domain 1706 (as might be the caseif the entity 1710 had been transferred from the second domain 1706 tothe first domain 1704).

Again as may be seen, in FIG. 17 with respect to the first viewer 1702the second viewer 1712 does not have a second domain associatedtherewith, nor any entities therein.

Now with reference to FIG. 18 , again a first viewer 1802 and a secondviewer 1812 are present therein. However, the arrangement in FIG. 18 isshown with respect to the second viewer 1812, so that what is present inFIG. 18 is what could be perceived by the second viewer 1812. A firstdomain 1804 substantially fills the environment surrounding the firstand second viewers 1802 and 1812, except for a second domain 1816disposed behind the second viewer 1812. The first domain 1804 and seconddomain 1816 are in communication via bridges 1818A and 1818B. Inaddition, an entity 1820 is present in the second domain 1816.

As may be seen, with respect to the second viewer 1812 the first viewer1802 does not have a second domain associated therewith, nor anyentities therein. However, as also may be seen, an entity 1810 ispresent in the first domain 1804, as might present if the entity 1810had been transferred to the first domain 1804 from a second domainassociated with the first viewer 1802. It is emphasized that FIG. 18 isshown with respect to the second viewer, and that even though the secondviewer 1812 could perceive no second domain associated with the firstviewer 1802, nevertheless an entity 1810 drawn from a second domainassociated with the first viewer 1802 may be visible to the secondviewer 1812 once that entity 1810 is in the first domain 1804. Thesecond viewer 1812 likewise may interact with such an entity 1810 whilein the first domain 1804, even if the entity 1810 was previously in asecond domain inaccessible to that second viewer 1812.

In effect, then, from the standpoint of viewers within an environmenthaving first and second domains according to the present invention, itis possible for entities to manifest to some or all viewers thatpreviously were not apparent to those viewers, to some appearances as ifpulled out of another viewer’s back pocket, or from “hammerspace”.Entities likewise may be made to apparently disappear in similarfashion.

The previous discussion addressed an arrangement wherein a bridge and/ora second domain is disposed behind a viewer’s back, so as to be out ofsight of that viewer. However, other arrangements that may dispose abridge and/or a second domain out of sight of a viewer may also beequally suitable, including but not limited to the following.

With reference to FIG. 19 , a diagram illustrating a typical humanvisual field is shown therein. Peripheral numbers indicate angleclockwise from the vertical, while radial numbers indicate angle outwardfrom a nominal centerline. As human vision typically is stereo innature, as may be expected a visual field is a combination of twoindividual sub-fields, a right sub-field 1932 as viewed by the right eyeand a left sub-field 1934 as viewed by the left eye. It is noted thatthe visual field shown in FIG. 19 is an example only for purposes ofillustration; variations may exist among individuals and even withinindividuals over time, etc.

So long as a bridge is disposed substantially at the edge of a viewer’scombined visual field 1932 and 1934, and/or is disposed substantiallyoutside the combined visual field 1932 and 1934, that bridge will not bevisible to the viewer (even if the bridge is resolved in a nominallyvisible form, though as previously noted such resolution is notrequired). To assure such non-visibility, a bridge might be disposed forexample at some angular distance outside the nominal combined visualfields 1932 and 1934; an example of such an angular distance beyond thecombined visual fields 1932 and 1934 is indicated by the outline 1936 inFIG. 19 ; as shown the outline 1936 is approximately 10 degrees beyondthe combined visual fields 1932 and 1934. If one or more bridges weredisposed anywhere along such an outline 1936, or even if the entirety ofthe outline 1936 were to serve as a bridge, such a bridge would not bevisible to the viewer.

It is noted that the arrangements shown in FIG. 14 through FIG. 17 , maybe considered special cases of such an arrangement. In FIG. 14 throughFIG. 17 second domains therein are disposed behind the viewersassociated therewith, thus being outside of the fields of view of thoseviewers. Disposing the bridge substantially at or substantially outsidethe edges of the visual field 1932 and 1934 as shown in FIG. 19 may be aconsidered a more general arrangement.

However, an arrangement wherein a bridge is outside the visual field ofa viewer is an example only, and the present invention is not limitedthereto. In addition, the present invention does not require that abridge be disposed so as to be non-visible to a viewer associatedtherewith (or to any other viewer).

Thus far description has focused mainly on static arrangements, that is,arrangements of first domain(s), second domain(s), bridge(s), andviewer(s) wherein all such entities remain substantially fixed inposition and/or orientation. However, the present invention does notrequire static arrangements, and is not limited thereto.

With reference now to FIG. 20A, an arrangement is shown therein with aviewer 2002A, a first domain 2004A, a second domain 2006A, and a bridgetherebetween 2008A. In addition, an approximation of the visual field2005A of the viewer is shown therein; in practice a particular viewer’svisual field may not exactly match the visual field 2005A as shown inFIG. 20A (e.g. possibly being broader, narrower, less uniform, etc.),but the visual field 2005A as shown serves as a representation thereof.

Also, for references purposes (as will be described below) a stationaryposition reference mark 2001A is shown in FIG. 20A. As may be seen, thereference mark 2001A is disposed centrally in front of the viewer 2002A,at some distance therefrom. It is also pointed out that the bridge 2008Ais disposed to the right of the viewer 2002A, angled so as to faceapproximately toward the right shoulder (and perhaps the hand, notshown) of the viewer 2008A.

Turning to FIG. 20B, an arrangement is shown that is at least somewhatsimilar to FIG. 20A, including a viewer 2002B, a first domain 2004B, asecond domain 2006B, and a bridge therebetween 2008B, along with areference mark 2001B and an outline approximating the viewer’s visualfield 2005B. However, in FIG. 20B the viewer 2002B has translatedforward compared with FIG. 20A. This translation may be noted inparticular through comparison of the relative position of the viewer2002B to the mark 2001B in FIG. 20B with the relative position of theviewer 2002A to the mark 2001A in FIG. 20A.

Despite the translation, it may be observed that the relative positionand orientation of the bridge 2008B to the viewer 2002B in FIG. 20B issubstantially the same as the relative position and orientation of thebridge 2008A to the viewer 2002A in FIG. 20A. Thus, the bridge 2008B inFIG. 20B has not moved with respect to the viewer 2002B, or with respectto the viewer’s visual field 2005B. Likewise the second domain 2006B hasnot moved with respect to either the bridge 2008B, the viewer 2002B, orthe viewer’s visual field 2005B. However, the bridge 2008B and thesecond domain 2006B each have moved relative to the mark 2001B.Depending on whether the first domain 2004B is and/or is considered tobe stationary with respect to the mark 2001B, it may also be accurate tostate that the bridge 2008B and the second domain 2006B each have movedrelative to the first domain 2004B.

Moving on to FIG. 20C, an arrangement is shown that is again at leastsomewhat similar to FIG. 20A and FIG. 20B, including a viewer 2002C, afirst domain 2004C, a second domain 2006C, and a bridge therebetween2008C, along with a reference mark 2001C and an outline approximatingthe viewer’s visual field 2005C. However, in FIG. 20C the viewer 2002Chas rotated approximately 45 degrees to the right compared with FIG.20B. This rotation may be noted in particular through comparison of therelative position and orientation of the viewer 2002C to the mark 2001Cin FIG. 20C with the relative position and orientation of the viewer2002B to the mark 2001B in FIG. 20B.

Despite the rotation, it may be observed that the relative position andorientation of the bridge 2008C to the viewer 2002C in FIG. 20C issubstantially the same as the relative position and orientation of thebridge 2008B to the viewer 2002B in FIG. 20B. Thus, the bridge 2008C inFIG. 20C has not moved with respect to the viewer 2002C, or with respectto the viewer’s visual field 2005C. Likewise the second domain 2006C hasnot moved with respect to either the bridge 2008C, the viewer 2002C, orthe viewer’s visual field 2005C. However, the bridge 2008C and thesecond domain 2006C each have moved relative to the mark 2001C.Depending on whether the first domain 2004C is and/or is considered tobe stationary with respect to the mark 2001C, it may also be accurate tostate that the bridge 2008C and the second domain 2006C each have movedrelative to the first domain 2004C.

In the examples shown in FIG. 20A through FIG. 20C, the bridge andsecond domain move so as to remain substantially in the same positionand/or orientation with respect to the viewer. While such an arrangementmay be useful for at least some embodiments, it is not required that thebridge and/or second domain remain stationary with respect to theviewer.

With reference now to FIG. 20D, an arrangement is shown therein with aviewer 2002D, a first domain 2004D, a second domain 2006D, and a bridgetherebetween 2008D. An approximation of the visual field 2005D of theviewer is shown therein, and a stationary position reference mark 2001D.

A comparison of FIG. 20D to FIG. 20A will reveal that the viewer 2002Din FIG. 20D is in substantially the same position and orientation withrespect to the reference mark 2001D as is the viewer 2002A in FIG. 20Awith respect to the reference mark 2001A therein. That is, the viewer isin substantially the same position and orientation in FIG. 20A and FIG.20D. However, as may also be seen by comparison, in FIG. 20D the bridge2008D and the second domain 2006D have translated up and to the leftcompared to the position of the bridge 2008A and second domain 2006A inFIG. 20A. The bridge 2008D and the second domain 2006D thus may beconsidered to have translated with respect to the viewer 2002D.

With reference to FIG. 20E, another arrangement is shown therein with aviewer 2002E a first domain 2004E, a second domain 2006E, and a bridgetherebetween 2008E. An approximation of the visual field 2005E of theviewer is shown therein, and a stationary position reference mark 2001E.

Again, a comparison of FIG. 20E to FIG. 20A will reveal that the viewer2002E in FIG. 20E is in substantially the same position and orientationwith respect to the reference mark 2001E as is the viewer 2002A in FIG.20A with respect to the reference mark 2001A therein. That is, theviewer is in substantially the same position and orientation in FIG. 20Aand FIG. 20E. However, as may also be seen by comparison, in FIG. 20Ethe bridge 2008E has rotated approximately 45 degrees clockwise comparedto the orientation of the bridge 2008A in FIG. 20A. The second domain2006E in FIG. 20E has also changed position and orientation relative tothe viewer 2002E but has retained position and orientation relative tothe bridge 2008E. The bridge 2008E and the second domain 2006D thus maybe considered to have rotated with respect to the viewer 2002E

It will be understood that while motions are shown individually in FIG.20A through FIG. 20E for clarity, combined motions, e.g. the viewermoving while the bridge and/or second domain also moves, may also besuitable. Likewise, it will be understood that although examples ofmotions are given, the present is not limited only to the specificmotions shown herein.

Motions of the bridge, the second domain, etc. may be managed innumerous ways. For example, in at least some embodiments a viewer mightcommand the bridge, second domain, etc. to move relative to the viewer,and/or relative to some other point or feature. Commands might bedelivered to a processor controlling the environment, and might includeverbal commands, gestural commands, eye motion commands, etc.

Alternately, the bridge, second domain, etc. may move partly or entirelyautomatically, without requiring deliberate user commands. For example,as a viewer moves, the bridge, second domain, etc. may move so as toremain substantially stationary with respect to the viewer, perhapsbehaving in a fashion similar to that shown in FIG. 20A through FIG.20C(although the arrangement shown therein does not necessarily excludethe use of viewer commands, the behavior shown is such that the bridgeand second domain remain substantially stationary with respect to theviewer).

As yet another alternative, some combination of commanded and automaticmotion may be suitable for at least certain embodiments. For example, adefault or “rest” position and/or orientation for the bridge, seconddomain, etc. may be defined in a processor, set by a viewer, orotherwise established. Absent input from the viewer, the bridge, seconddomain, etc. may then maintain substantially constant position and/ororientation with respect to the viewer (or some other point or feature),while still moving if commanded. Moreover, in at least some embodimentsthe bridge, second domain, etc. may be biased towards their restposition and/or orientation, such that e.g. when not being commanded thebridge, second domain, etc. tends to return towards their rest positionand/or orientation.

In arrangements having such a rest position and/or a rest orientation,the rest position and/or rest orientation may vary considerably. Forexample, with respect to rest positions for certain embodiments it maybe useful to dispose a rest position outside the visual field of theviewer, substantially at the edge of the visual field of the viewer, orpartly or entirely within the visual field of the viewer. The restorientation likewise may vary.

Other arrangements for motion, rest position and/or orientation, etc.also may be equally suitable.

Entities present in the first domain and/or the second domain also maybe moveable. It should be kept in mind that the distinction betweenfirst and second domain may be purely logical rather than necessarilyspatial, thus for example the second domain may not be a space in astrict sense, and the idea of motion within the second domain may not berelevant. As a more concrete example, if entities “within” the seconddomain exist only as data stored and/or manipulated on a processor, thesecond domain may have no dimensions and the notion of the position ofsuch entities within the second domain may be meaningless.

However, even for embodiments wherein position and/or orientation ismeaningful, and wherein entities are moveable, the motion behavior ofsuch entities may not necessarily be intuitive, nor is such motionrequired to correspond entirely (or even at all) with natural law asapplicable to physical objects.

For example, with reference to FIG. 21 an arrangement is illustratedwith two viewers 2102 and 2112 shown therein. As a preliminary matter,the viewer identified with reference number 2102 is referred to hereinas the alpha viewer 2102, and the viewer identified with referencenumber 2112 is referred to herein as the beta viewer. As will describedbelow, both viewers 2102 and 2112 have for example second domainsassociated therewith, and it is considered that terms such as “firstsecond domain”, “second second domain”, would be unnecessarilyconfusing.

In FIG. 21 , only one first domain 2104 is illustrated. While it ispossible to define independent first domains specific to each user, thearrangement in FIG. 21 assumes a single common first domain for allviewers, with each viewer having an individual second domain associatedspecifically with that viewer.

Behind the alpha viewer 2102 is an alpha second domain 2106 associatedtherewith, having first and second alpha bridges 2108A and 2108B incommunication with the first domain 2104. Similarly, behind the betaviewer 2112 a beta second domain 2116 associated therewith, having firstand second beta bridges 2118A and 2118B in communication with the firstdomain 2104. In addition, the beta second domain 2116 has therein anentity 2120.

Turning to FIG. 22 , an arrangement at least somewhat similar to that inFIG. 21 is shown, except that the beta viewer 2212 is rotatedapproximately 90 degrees clockwise. FIG. 21 also includes a first domain2204 and an alpha viewer 2202. An alpha second domain 2206 is shownassociated with the alpha viewer 2202, having first and second alphabridges 2208A and 2208B in communication with the first domain 2204. Abeta second domain 2116 is shown associated with the beta viewer 2112,having first and second beta bridges 2218A and 2218B in communicationwith the first domain 2204. In addition, the beta second domain 2216 hastherein an entity 2220.

Assuming for illustrative purposes that FIG. 21 and FIG. 22 representsequential events, it may be considered that the beta viewer 2212 inFIG. 22 has rotated 90 degrees clockwise. It is noted that the betabridges 2218A and 2218B and the beta second domain 2216 likewise movewith the beta viewer 2212. Furthermore, the entity 2220 also moves withthe viewer. It is emphasized that the entity 2220, although not visiblyrestrained, does not remain in place as the beta viewer 2212 moves; theentity 2220 is not left behind. Where a purely physical object might besubject to inertia, might have to be restrained, etc., as illustrated inFIG. 22 the entity 2220 moves substantially with the beta bridges 2218Aand 2218B and the beta second domain 2216, such that the entity 2220remains substantially stationary with the beta bridges 2218A and 2218Band the beta second domain 2216 (and likewise with the beta viewer 2212,since the beta bridges 2218A and 2218B and the beta second domain 2216are shown to remain substantially stationary with respect to the betaviewer 2212).

Thus, with reference to FIG. 21 and FIG. 22 , motion of second domains,bridges, etc. in and of itself does not necessarily cause a transfer ofentities from a second domain into a first domain, even if a seconddomain moves so as to overlap an entity, and even if a bridge moves suchthat an entity passes spatially therethrough.

With reference to FIG. 23 , an arrangement is shown with an alpha viewer2302, a beta viewer 2312, and a first domain 2304. An alpha seconddomain 2306 is shown associated with the alpha viewer 2302, having firstand second alpha bridges 2308A and 2308B in communication with the firstdomain 2304. A beta second domain 2316 is shown associated with the betaviewer 2312, having first and second beta bridges 2318A and 2318B incommunication with the first domain 2304. In addition, an entity 2310 isdisposed within the first domain 2304.

Turning now to FIG. 24 , another arrangement is shown that is at leastsomewhat similar to that of FIG. 23 , the arrangement of FIG. 24 alsohaving an alpha viewer 2402, a beta viewer 2412, and a first domain2404. An alpha second domain 2406 is shown associated with the alphaviewer 2402, having first and second alpha bridges 2408A and 2408B incommunication with the first domain 2404. A beta second domain 2416 isshown associated with the beta viewer 2412, having first and second betabridges 2418A and 2418B in communication with the first domain 2404.

An entity 2410 also is shown.

It is noted that as compared with FIG. 23 , in FIG. 24 the beta viewer2412 is rotated approximately 135 degrees clockwise, with the betasecond domain 2416 and the beta bridges 2418A and 2418B being rotatedtherewith.

Assuming for illustrative purposes that FIG. 23 and FIG. 24 representsequential events, it may be considered that the beta viewer 2412 inFIG. 24 has rotated 135 degrees clockwise. Because the beta bridges2418A and 2418B and the beta second domain 2416 likewise move with thebeta viewer 2412, the beta second domain 2416 now overlaps the entity2410. However, if as stated FIG. 23 and FIG. 24 are considered to besequential, then the entity 2410 in FIG. 24 corresponds with the entity2310 in FIG. 23 . As described previously with reference to FIG. 23 ,the entity 2310 therein is disposed in the first domain 2304. If FIG. 23and FIG. 24 are considered to be sequential, the entity 2410 in FIG. 24therefor likewise will be in the first domain 2404, absent anappropriate stimulus being executed so as to transfer the entity 2410into either the alpha second domain 2406 or the beta second domain 2416.

Thus, with reference to FIG. 23 and FIG. 24 , motion of second domains,bridges, etc. in and of itself does not necessarily cause a transfer ofentities from a first domain into a second domain, even if a seconddomain moves so as to overlap an entity, and even if a bridge moves suchthat an entity passes spatially therethrough.

Similarly, it will be understood that just as motion of domains,bridges, etc. with respect to stationary entities does not necessarilytransfer those entities between first and second domains (with referenceto FIG. 21 and FIG. 22 , and FIG. 23 and FIG. 24 ), likewise motion ofentities with respect to stationary domains, bridges, etc. does notnecessarily transfer those entities between first and second domains.Furthermore, combined motions of moving domains, bridges, etc. andmoving entities also do not necessarily transfer entities between firstand second domains.

Rather, entities are transferred between first and second domainsthrough execution of first and second stimuli. Although first and/orsecond stimuli may include spatial motions of entities and/or firstdomains and/or second domains, such spatial motions alone are notnecessarily sufficient to transfer entities between first and seconddomains, except in embodiments wherein the stimuli are specificallydefined such that such motions alone constitute the stimuli (in whichcase executing those motions would constitute executing the appropriatestimuli, which then may be sufficient for transfer between first andsecond domains).

As has been previously described, entities may be transferred from afirst domain to a second domain with a first stimulus, and from a seconddomain to a first domain with a second stimulus. However, the presentinvention is not limited only to such stimuli. Other stimuli forimplementing other functions may also be included. Additional stimulimay include, but are not limited to, a third stimulus that transfersentities between an alpha second domain and a beta second domain forembodiments wherein two or more viewers (alpha and beta) are present,each with a second domain associated therewith.

Although bridges as previously described herein are adapted tocommunicate between first and second domains, bridges may be adapted tocommunicate between alpha second domains and beta second domains inaddition or instead. This may be counterintuitive if first domains,second domains, and/or bridges are considered to be spatial objects.However, as has been previously stated, first domains, second domains,and/or bridges are not required to be spatially defined, and may bepurely logical in nature.

Thus, for example, a bridge may be adapted to transfer objects between afirst domain and an alpha second domain, and also may be adapted totransfer objects between an alpha second domain and a beta seconddomain, even if there is no apparent spatial connection therebetween(and even if in terms of geometry such a spatial connection may appearimpossible).

It is emphasized that the bridge, like the first and second domains, maybe partly or entirely a logical construct. While a bridge may havespatial dimension, and may function spatially (e.g. as a spatial linkbetween spatially-defined first and second domains), this is notrequired, and the present invention is not limited only thereto. Thebridge may, for certain embodiments, have substantially no dimensionalform at all, rather being implemented only as executable instructionsfor transferring entities from one domain to another in response toappropriate first and second stimuli. Thus, for certain embodiments abridge might also transfer entities between alpha and beta seconddomains associated with alpha and beta viewers, e.g. in response to athird stimulus.

In similar fashion as described above with respect to FIG. 21 throughFIG. 24 , for an arrangement wherein a bridge may transfer an entityfrom an alpha second domain to a beta second domain, motion alone is notnecessarily sufficient to effect a transfer absent a third stimulus.Such functionality is illustrated in FIG. 25 and FIG. 26 .

In FIG. 25 , an example arrangement is shown with an alpha viewer 2502,a beta viewer 2512, and a first domain 2504. An alpha second domain 2506is shown associated with the alpha viewer 2502, having first and secondalpha bridges 2508A and 2508B in communication with the first domain2504. A beta second domain 2516 is shown associated with the beta viewer2512, having first and second beta bridges 2518A and 2518B incommunication with the first domain 2504. In addition, an entity 2510 isdisposed within the alpha second domain 2506.

Turning now to FIG. 26 , another arrangement is shown that is at leastsomewhat similar to that of FIG. 25 , the arrangement of FIG. 26 alsohaving an alpha viewer 2602, a beta viewer 2612, and a first domain2604. An alpha second domain 2606 is shown associated with the alphaviewer 2602, having first and second alpha bridges 2608A and 2608B incommunication with the first domain 2604. A beta second domain 2616 isshown associated with the beta viewer 2612, having first and second betabridges 2618A and 2618B in communication with the first domain 2604.

FIG. 26 also shows therein an entity 2610.

It may be considered for the sake of the example of FIG. 26 that alphabridges 2608A and 2608B and/or beta bridges 2618A and 2618B are adaptedto communicate between alpha second domain 2606 and beta second domain2616, since absent such communication consideration of the potentialtransfer of an entity 2610 from the alpha second domain 2606 and betasecond domain 2616 via the alpha bridges 2608A and 2608B and/or betabridges 2618A and 2618B would be moot.

As compared with FIG. 25 , in FIG. 26 the beta viewer 2612 is rotatedapproximately 60 degrees counterclockwise, with the beta second domain2616 and the beta bridges 2618A and 2618B being rotated therewith.

Assuming for illustrative purposes that FIG. 25 and FIG. 26 representsequential events, it may be considered that the beta viewer 2612 inFIG. 24 has rotated 60 degrees counterclockwise. Because the betabridges 2618A and 2618B and the beta second domain 2616 likewise movewith the beta viewer 2612, the beta second domain 2616 now overlaps thealpha second domain 2606 and the entity 2610 in the alpha second domain2606. However, although the beta second domain 2616 now overlaps theentity 2610, the entity 2610 is not necessarily transferred to orotherwise present in the beta second domain 2616, absent an appropriatestimulus (e.g. a third stimulus) being executed so as to transfer theentity 2610 into the beta second domain 2616.

Thus, with reference to FIG. 25 and FIG. 26 , motion of second domains,bridges, etc. in and of itself does not necessarily cause a transfer ofentities from an alpha second domain into a beta second domain, even ifone or both of the alpha and beta second domains move so as to overlapan entity, and even if a bridge moves such that an entity passesspatially therethrough. Similarly, motion of entities with respect tostationary domains, bridges, etc. does not necessarily transfer thoseentities between alpha and beta second domains. Furthermore, combinedmotions of moving domains, bridges, etc. and moving entities also do notnecessarily transfer entities between alpha and beta second domains.Rather, entities are transferred between alpha and beta second domainsthrough execution of third stimuli.

With respect collectively to FIG. 21 through FIG. 26 , transfer ofentities between domains does not happen by incidental motions ofdomains, bridges, entities, etc., or otherwise accidentally, but ratherin response to appropriate stimuli.

Moving on to FIG. 27 , some or all of the contents of the environment,including but not limited to at least a portion of the first domain, maybe outputted in some form. For example, FIG. 27 shows an arrangementwith an output window 2722. The output window 2722, in the example asshown, is a two-dimensional image of a portion of the overallenvironment, including at least a portion of the first domain 2704.Output through an output window is not limited to only the first domain2704 or a portion thereof, however. As may be seen, the window 2722 alsoshows a portion of the second domain 2706, a portion of a viewer’s hand2703, a portion of an entity 2710 disposed within the first domain, anda portion of the bridge 2708 communicating between the first and seconddomains 2704 and 2706.

A window 2722 as shown in FIG. 27 might, for example, represent an imagedisplayed on systems including but not limited to a television, amonitor, a screen of a portable device, etc. Such a window 2722 couldthen output in a readily viewable form some or all of the environment,including at least a portion of the first domain 2704, etc. For example,for an arrangement wherein the first and second domains 2704 and 2706and bridge 2708 are defined logically on a processor, and/or controlledby that processor, the appearance, manipulations, functions, etc.relating to the first and second domains 2704 and 2706 and bridge 2708,any entities associated therewith, etc. could be displayed through sucha window 2722. However, such an arrangement is an example only, andother arrangements may be equally suitable.

One example of such an alternative arrangement is shown in FIG. 28 .Therein, first and second windows 2822A and 2822B are shown. The firstand second windows 2822A and 2822B display somewhat similar content,however as may be seen the 2822A and 2822B have slightly differingperspectives on that content, as might be expected for windows in astereo arrangement. That is, the first window 2822A shows portions of afirst domain 2804A, a second domain 2806A, a bridge 2808A therebetween,a viewer’s hand 2803A, and an entity 2810A disposed in the first domain2804A. Similarly, the second window 2822B also shows portions of a firstdomain 2804B, a second domain 2806B, a bridge 2808B therebetween, aviewer’s hand 2803B, and an entity 2810B, but the portions thereof asshown are from a point of view slightly to the left of the point of viewin the first window 2822A. Taken together, such a stereo pair of windows2822A and 2822B may serve to provide the appearance of depth,three-dimensionality, etc. even for two dimensional display systems. Forexample, a viewer utilizing a head mounted display or other devicehaving stereo windows 2822A and 2822B might perceive a virtual and/oraugmented reality environment in three dimensions, as though physicallyimmersed therein, even if that environment (and the first domain, seconddomain, etc.) exist within a processor and are outputted only to twodimensional display screens.

However, the use of stereo output windows, and the use of output windowsgenerally, are examples only, and the present invention is not limitedonly thereto.

With reference now to FIG. 29 , an example embodiment of method stepsaccording to the present invention is shown therein.

In the example method of FIG. 29 , it is identified whether an entity ispresent in a first domain 2930. It is also identified whether an entityis present in a second domain 2932. Entities, first domains, and seconddomains according to the present invention have been describedpreviously herein.

The manner by which the presence of an entity in the first and/or seconddomains may be identified 2930 and 2932 may vary considerably, and thepresent invention is not particularly limited with respect thereto. Forexample, for an embodiment wherein the entities in question are virtualobjects, identifying the presence of an entity in the first domain 2930and/or in the second domain 2932 may be accomplished by evaluating datain a processor controlling the first and/or second domains. That is, fora particular entity that is a virtual entity represented by data in aprocessor, the location of that particular entity within the firstand/or second domains may be acquired by analysis of data in theprocessor associated with the entity. However, this is an example only,and other arrangements may be equally suitable.

Moving on in FIG. 29 , it is identified whether a first stimulus ispresent 2934. It is also identified whether a second stimulus is present2936. First and second stimuli according to the present invention alsohave been described previously herein. With regard to being present, itis noted that stimuli need not necessarily be present in a first orsecond domain. For at least certain embodiments stimuli may be executedwithin a first domain and/or a second domain, e.g. executing a gesturalfirst stimulus within the first domain, executing a gestural secondstimulus within the second domain, etc. However, stimuli may be executedin multiple domains (for example initiating in a first domain andtransitioning into a second domain, or vice versa), or may be executedoutside either a first or a second domain according to the presentinvention.

The identification 2934 and 2934 of the presence of a first stimulusand/or a second stimulus also may be executed in many ways, and thepresent invention is not particularly limited with respect thereto. Forexample, for an embodiment wherein the first and second stimuli aregestures with a hand or other end-effector, a sensor such as a cameramay be used to sense the gestures being executed. However, this is anexample only, and other arrangements may be equally suitable.

Continuing in FIG. 29 , a determination is made 2938 as to whether anentity is present in the first domain (as identified in step 2930) and afirst stimulus is present (as identified in step 2934). Both factorsmust be positive for the determination to be positive. If thedetermination is positive-if an entity is present in the first domainand a first stimulus is present—then the method continues with step 2940(below). If the determination is negative-if an entity is present in thefirst domain but the first stimulus is not present, if a first stimulusis present but no entity is present in the first domain, or if no entityis present in the first domain and no first stimulus is present—then themethod skips step 2940 and continues with step 2942 (below).

If the determination in step 2938 is positive, the entity in question istransferred 2940 to the second domain.

Moving on in FIG. 29 , a determination is made 2942 as to whether anentity is present in the second domain (as identified in step 2932) anda second stimulus is present (as identified in step 2936). Again, bothfactors must be positive for the determination to be positive. If thedetermination is positive-if an entity is present in the second domainand a second stimulus is present—then the method continues with step2944 (below). If the determination is negative—if an entity is presentin the second domain but the second stimulus is not present, if a secondstimulus is present but no entity is present in the second domain, or ifno entity is present in the second domain and no second stimulus ispresent—then the method skips step 2944 and continues with step 2950(below).

If the determination in step 2942 is positive, the entity in question istransferred 2944 to the first domain.

At least a portion of the first domain is then outputted 2950.Typically, although not necessarily, at least a portion of the firstdomain is outputted 2950 to a viewer, e.g. through a monitor, displayscreen on a hand-held device, head mounted display, etc. It is alsopermitted but not required to output the entirety of the first domain,and/or any content (such as entities) that may be disposed within and/orvisible within the portion of the first domain. Other output also may bepermitted but is not required, including but not limited to some or allof the second domain, some or all of the bridge, some or all of entitiespresent within the first and/or second domain, etc.

Typically, but not necessarily, the method of claim 29 is executed morethan once, e.g. repeating from step 2930 after having completed step2950. For example, a processor or other system executing the methodmight cycle through executable instructions for implementing the methodsteps in a repeating loop, so as to determine in an ongoing mannerwhether to transfer an entity between the first and second domains andto execute such a transfer as appropriate.

Turning now to FIG. 30 , while the present invention may be implementedwith only a single entity under consideration, for at least someembodiments it may be useful to manage and/or manipulate multipleentities. For simplicity, FIG. 29 was presented with the assumption thatonly one entity may be present. By contrast, FIG. 30 shows an exampleembodiment of method steps adapted for addressing multiple entitiesaccording to the present invention.

In the example method of FIG. 30 , it is identified whether one or moreentities are present in a first domain 3030. It is also identifiedwhether one or more entities are present in a second domain 3032. Eitheror both of the first and second domains may have no entities therein,one entity therein, or multiple entities therein. Regardless of thenumber of entities, entities therein are identified as present in theappropriate domains.

It is also identified whether a first stimulus is present 3034 inassociation with one or more of the entities (if any) in the firstdomain. It is further identified whether a second stimulus is present3036 in association with one or more of the entities (if any) in thesecond domain. First and/or second stimuli may be applied to multipleentities at a time, or only to one entity. Identification of whether afirst or second stimulus is associated with a particular entity may beaccomplished in many ways, and the present invention is not particularlylimited with respect thereto. For example, for first and second stimulithat are gestural in nature, a gesture may be identified as beingassociated with a particular entity based on contact with the entity, ondistance to the entity (e.g. some minimum distance between hand or otherend-effector and entity), on previous selection of the entity, etc.Other arrangements may be equally suitable.

Continuing in FIG. 30 , a determination is made 3038 as to whether anentity is present in the first domain (as identified in step 3030) and afirst stimulus associated therewith is present (as identified in step3034). A distinction is noted here as compared with FIG. 29 : it ispossible for an entity to be present within the first domain, and afirst stimulus to be present, without satisfying the determination ofstep 3038. Namely, if an entity is present in the first domain, and afirst stimulus is present, but the first stimulus is not associated withthe entity, then the determination 3038 is negative. Only if an entityis present in the first domain, and a first stimulus is present, and thefirst stimulus and the entity are associated, is the determination 3038positive.

If the determination 3038 is positive, then the method continues withstep 3040 (below). If the determination is negative, then the methodskips step 3040 and continues with step 2942 (below).

If the determination in step 3038 is positive, the entity in question istransferred 3040 to the second domain.

Moving on in FIG. 30 , a determination is made 3042 as to whether anentity is present in the second domain (as identified in step 3032) anda second stimulus associated therewith is present (as identified in step3036). As with step 3038, the determination of step 3042 is positiveonly if an entity is present in the second domain, and a first stimulusis present, and the first stimulus and the entity are associated.

If the determination 3042 is positive, then the method continues withstep 3044 (below). If the determination is negative, then the methodskips step 3044 and continues with step 3050 (below).

If the determination in step 3042 is positive, the entity in question istransferred 3044 to the second domain.

At least a portion of the first domain is then outputted 3050.

Turning now to FIG. 31 , although the present invention may beimplemented so as to enable only transfers between one first domain andone second domain, for at least some embodiments it may be useful toenable transfers between two or more second domains. For example, in anarrangement wherein a single viewer has access to two or more seconddomains (or wherein a second domain has two or more distinct parts),entities might be transferred therebetween without necessarily beingtransferred to a first domain. Alternately, in an arrangement whereintwo or more viewers each have a second domain, entities might betransferred between respective second domains likewise withoutnecessarily being transferred to a first domain. For such arrangements,a third stimulus might for example be utilized to transfer entities fromone second domain to another. FIG. 31 shows an example embodiment ofmethod steps adapted for transferring entities between second domainsthrough the use of a third stimulus according to the present invention.

The arrangement of FIG. 31 is an example only. Other arrangementsutilizing a third stimulus may also be implemented, potentially withfunctions other than transfers between second domains. Likewise,addition stimuli beyond a third stimulus also may be implemented, withadditional functions.

In the example method of FIG. 31 , it is identified whether an entity ispresent in a first domain 3130. It is also identified whether an entityis present in an alpha second domain 3132. (As in certain previousexamples herein, where two or more second domains are referenced thosesecond domains are distinguished as the alpha second domain, the betasecond domain, etc. The alpha second domain therefor represents a seconddomain in which an entity is disposed initially, while a beta seconddomain-referenced below-represents a second domain into which the entitymay be transferred.)

It is identified whether a first stimulus is present 3134. It is alsoidentified whether a second stimulus is present 3136. It is furtheridentified whether a third stimulus is present 3137. As with the firstand second stimuli, identifying a third stimulus may be executed in manyways, and the present invention is not particularly limited with respectthereto. For example, for an embodiment wherein the first and secondstimuli are gestures with a hand or other end-effector, a sensor such asa camera may be used to sense the gestures being executed. However, thisis an example only, and other arrangements may be equally suitable.

A determination is made 3138 as to whether an entity is present in thefirst domain (as identified in step 3130) and a first stimulus ispresent (as identified in step 3134). If the determination is positivethen the method continues with step 3140 (below). If the determinationis negative then the method skips step 3140 and continues with step 3142(below).

If the determination in step 3138 is positive, the entity in question istransferred 3140 to the alpha second domain.

Moving on in FIG. 31 , a determination is made 3142 as to whether anentity is present in the alpha second domain (as identified in step3132) and a second stimulus is present (as identified in step 3136). Ifthe determination is positive then the method continues with step 3144(below). If the determination is negative then the method skips step3144 and continues with step 3146 (below).

If the determination in step 3142 is positive, the entity in question istransferred 3144 to the first domain.

A determination is also made 3146 as to whether an entity is present inthe alpha second domain (as identified in step 3132) and a thirdstimulus is present (as identified in step 3137). If the determinationis positive then the method continues with step 3148 (below). If thedetermination is negative then the method skips step 3148 and continueswith step 3150 (below).

If the determination in step 3146 is positive, the entity in question istransferred 3148 to the beta second domain.

At least a portion of the first domain is then outputted 3150.

Typically, though not necessarily, when implemented for alpha and betaviewers the arrangement of FIG. 31 may be implemented such that an alphaviewer may transfer an entity from an alpha second domain associatedwith the alpha viewer to a beta second domain associated with the betaviewer. That is, a viewer “exports” an entity from a second domainassociated with that viewer into a second domain associated with anotherviewer. However, other arrangements, including but not limited to“importing” an entity from a second domain associated with anotherviewer, may be equally suitable.

As has been indicated previously, certain embodiments of the presentinvention may be executed as a machine-implemented method. For example,method steps may be executed on a data processor. In addition, adefinitions may be loaded onto and/or defined on a data processor,and/or executable instructions instantiated thereon, so as to enableexecution of method steps according to the present invention. FIG. 32shows such an arrangement.

Referring now to FIG. 32 , in a processor, a first domain is defined3260. A second domain distinct from the first domain also is defined3262. A bridge is defined 3264 so as to dispose the first and seconddomains in communication by supporting transfer of entitiestherebetween. First and second domains and bridges according to thepresent invention have been described previously herein. It is againpointed out that first and second domains and bridges are, or at leastmay be, logical constructs, and thus for at least some embodiments mayexist entirely or at least primarily as definitions and/or data on aprocessor.

A first stimulus is defined 3266. A second stimulus also is defined3268. First and second stimuli according to the present invention alsohave been previously described herein.

A first response to the first stimulus is defined 3270, the firstresponse being to transfer an entity to the second domain. A secondresponse to the second stimulus is also defined 3272, the secondresponse being to transfer an entity to the first domain. Transfer ofentities between first and second domains has been previously describedherein.

Executable instructions are instantiated on the processor 3274 toidentify whether an entity is present in the first domain. Executableinstructions also are instantiated 3276 whether an entity is present inthe second domain. Executable instructions are instantiated 3278 toidentify the presence of the first stimulus. Executable instructions areinstantiated 3280 to identify the presence of the second stimulus.

Executable instructions are instantiated 3282 to execute the firstresponse, that is, to transfer an entity from the first domain to thesecond domain. Executable instructions are instantiated 3284 to executethe second response, that is, to transfer an entity from the seconddomain to the first domain.

Executable instructions are instantiated 3286 to output at least aportion of the first domain.

Turning now to FIG. 33 , a schematic of an example apparatus 3390according to the present invention is shown therein.

The apparatus 3390 includes a processor 3391, an entity identifier 3392in communication with the processor 3391, a stimulus identifier 3393 incommunication with the processor 3391, and a display 3394 incommunication with the processor 3391.

The processor 3391 is adapted to define a first domain and a seconddomain substantially distinct from said first domain, with the first andsecond domains each having at least two dimensions. The processor 3391also is adapted to define a bridge such that the first and seconddomains are in communication via the bridge so as to enable transfer ofan entity between the first and second domains via the bridge. Theprocessor 3391 is further adapted to transfer an entity from the firstdomain to the second domain in response to a first stimulus, and totransfer an entity from the second domain to the first domain inresponse to a second stimulus.

A range of general-purpose, special-purpose, and embedded systems may besuitable for use as the processor 3391. It may also be suitable for theprocessor 3391 to consist of two or more physical or logical processorcomponents.

The entity identifier 3392 is adapted to identify a presence of theentity in the first domain and/or in the second domain, and tocommunicate the presence of the entity in the first and/or second domainto the processor 3391.

The nature of the entity identifier 3392 is to at least some degreedependent on the nature of the entities in question. For an entityhaving at least some physical substance (e.g. for an augmented realityenvironment), an imager or other sensor adapted to detect physicalobjects may be suitable. For an entity that exists wholly or partiallyas data, physical sensors may be less suited, although in at least someinstances physical sensors may nevertheless detect evidence of entitieseven without detecting the entities directly, for example by using animager to view entities as outputted on a display. Although the entityidentifier 3392 may be a sensor in some embodiments, this is notrequired.

The stimulus identifier 3393 is adapted to identify the first and secondstimuli, and to communicate the presence of the first and/or secondstimuli to the processor 3391.

As with the entity identifier 3392, the nature of the stimulusidentifier 3393 is to at least some degree dependent on the nature ofthe stimuli used for a particular embodiment. For visual stimuli such asgestures with a hand or other end-effector, a sensor such as an imagermay be suitable. Likewise, for audio stimuli an audio sensor might besuitable, for text inputs a keyboard might be suitable, etc. Althoughthe entity identifier 3392 may be a sensor in some embodiments, this isnot required, for example a keyboard in the previous example may besuitable but may not necessarily be considered a sensor per se.

The display 3394 is adapted to output at least a portion of the firstdomain.

A range of devices likewise may be suitable for use as the display 3394,including but not limited to light emitting diodes (LED), organic lightemitting diodes (OLED), plasma screen panels (PDP), liquid crystaldisplays (LCD), etc. Likewise, the use of projected or transmitteddisplays, where the viewed surface (if any) is essentially a passivescreen for an image projected or otherwise transmitted after beinggenerated elsewhere, may also be suitable. Other arrangements includingbut not limited to systems that display images directly onto a viewer’seyes also may also be suitable. Either digital or analog displaytechnologies may be suitable.

An apparatus according to the present invention may vary considerablyfrom one embodiment to another, in ways including but not limited to thefollowing.

Turning to FIG. 34 , another example of an apparatus 3490 according tothe present invention is shown therein. The apparatus 3490 includes aprocessor 3491 and a display 3494 in communication with the processor3491.

The apparatus 3490 also includes an entity identifier 3492A and 3492B.However, as may be seen, although one portion 3492A of the entityidentifier is a hardware component distinct from the processor 3491,another portion 3492B also is present in the form of executableinstructions instantiated on the processor 3491. In practice, an entityidentifier may be distinct and/or hardware based as is 3492A, or may bea set of executable instructions disposed on a processor as is 3492B, ormay be a combination thereof. An entity identifier that is partially orentirely executable instructions may be understood by considering anexample wherein entities to be manipulated are virtual entities that areprimarily or entirely data. For an entity that is in essence a dataconstruct, it may for certain embodiments be practical to identify thepresence of entities in first or second domains by reading the data ofthe entities, domains, etc. themselves. In such instance, an entityidentifier might exist entirely as executable instructions, with nohardware.

Similarly, the apparatus includes a stimulus identifier 3493A and 3493B.As with the entity identifier above, in FIG. 34 the stimulus identifiermay have either a hardware component 3493A distinct from the processor3491, a set of executable instructions 3493B instantiated on theprocessor 3491, or some combination thereof.

In addition, for certain embodiments it may be suitable to performmultiple functions with a single component. One example of such anarrangement may be seen in FIG. 34 wherein the processor 3491 may alsohave executable instructions serving as an entity identifier 3492Band/or as a stimulus identifier 3493B disposed thereon. However, otherarrangements also may be suitable. For example, a single imager or otherhardware device might, for example, serve both to identify stimuli andto identify entities. Thus, even if all functions of the apparatus asdescribed herein are facilitated by a particular embodiment of anapparatus, not all individual functions will necessarily be performed byindividual hardware components (or necessarily by individual sets ofexecutable instructions).

Furthermore, it is noted that although components of an apparatusaccording to the present invention may be integrated as a physicallyconnected unit, such physical connection is not required. For example,although a display might take the form of a monitor, head mounteddisplay screen, etc., wherein other components of the apparatus mightreadily be physically integrated therewith as a single device, otherdisplay arrangements may be equally suitable. One such displayarrangement might be an external projector or network thereof, such thata portion of the first domain may be outputted therewith. The outputtherefrom might then exist as an environment that is visible to a viewerwith the naked eye, and/or that is visible to multiple viewers at onetime, etc. However, it will be understood that such projectors—whichmight for example be disposed behind walls, in a ceiling, at intervalsaround a large physical space, etc.— will not necessarily be physicallyintegrated into a single device.

Likewise, although at least some of the description herein uses asexamples a portable, hand-held, and/or wearable apparatus or system, thepresent invention is not limited thereto. Embodiments that exist forexample as substantially stationary rooms, as enclosed environments,etc. may be equally suitable.

Turning now to FIG. 35 , an example embodiment of an apparatus 3590according to the present invention integrated as a head mounted displayunit. The embodiment shown in FIG. 35 includes a processor 3591, anentity identifier 3592 in communication with the processor 3591, astimulus identifier 3593 in communication with the processor 3591, and adisplay 3594 in communication with the processor 3591.

It is noted that the stimulus identifier 3593 is shown as a stereodevice, having first and second imaging sensors 3593A and 3593B arrangedin a stereo configuration. Similarly, the display 3594 is shown as astereo device, having first and second screens 3594A and 3594B arrangedin a stereo configuration. The use of stereo sensors and/or displays maybe useful for at least some embodiments, for at least the reason thatstereo systems enable the sensing and/or display of depth, so as tosupport a three dimensional environment. However, such an arrangement isan example only, and the present invention is not limited only to stereosystems.

In addition, the apparatus 3590 shown in FIG. 35 includes a body 3595 inthe form of a frame for a head mounted display. As shown the body 3595resembles a pair of glasses, but this is an example only, and otherconfigurations may be equally suitable. In the arrangement shown, thebody 3595 is such that when the body is worn 3595 the stereo displayscreens 3594A and 3594B would be disposed proximate and substantially infront of a viewer’s eyes.

With reference now to FIG. 36 , although the present invention has beendescribed herein mainly with respect to a relatively specific group ofactions responsive to gestures and other stimuli-namely the transfer ofan entity between first and second domains—the present invention is notlimited only to such responses. The present invention also may be usedto invoke responses other than transfer of entities between first andsecond domains.

Likewise, although the present invention has been described hereinmainly with respect to multiple stimuli each having a responseassociated therewith, e.g. first and second stimuli, the presentinvention also is not limited only thereto. A single stimulus may beutilized to selectively invoke one of multiple different responses, forexample based on where and/or when the stimulus is executed, e.g.executing the stimulus in the first domain as opposed to in the seconddomain, executing the stimulus beginning in the first domain andtransitioning to the second domain or vice versa, etc.

FIG. 36 shows an example embodiment of a method according to the presentinvention therein, wherein one stimulus may invoke multiple responsesbased on where the stimulus is executed.

In the example embodiment of FIG. 36 , it is identified 3631 whether anentity is present. Entities and identification thereof with regard tothe present invention have been previously described herein. However, itis noted that where certain previous examples referred to identifyingwhether an entity is present specifically in (for example) a firstand/or in a second domain, step 3631 is not so limited, nor is thepresent invention overall so limited. Although an entity in question maybe present in first and/or second domains for the example shown in FIG.36 , entities are not required to be present in first and/or seconddomains to be identified for step 3631.

Moving on in FIG. 36 , it is identified 3633 whether a stimulus ispresent initiating in a first domain and continuing into a seconddomain. Stimuli, first domains, and second domains according to thepresent invention have been previously described herein. It is notedthat transitioning a stimulus from a first domain to a second domainmay, for example, include initiating a hand gesture (for an arrangementwherein a hand gesture is used as a stimulus) within a first domain,then continuing the gesture as the hand moves from the first domain tothe second domain (e.g. via a bridge). However, other arrangements maybe equally suitable.

It is identified 3635 whether the stimulus is present initiating in thesecond domain and continuing into the first domain. It is alsoidentified 3639 whether the stimulus is present in the first domainonly, and it is further identified 3641 whether the stimulus is presentin the second domain only.

It is noted that for purposes of steps 3633, 3635, 3639, and 3641, asingle stimulus may be utilized in any of the four conditions (first tosecond domain, second to first domain, first domain only, second domainonly). That is, for an arrangement utilizing a gesture as a stimulus, asingle gesture may be identified in any of steps 3633, 3635, 3639, and3641 depending on where (in terms of domains) the gesture is executed.

Moving on in FIG. 36 , a determination 3643 is made as to whether anentity is present (as identified in step 3631) and the stimulus ispresent in the first domain transitioning to the second domain (asidentified in step 3633). If the determination 3643 is positive-if anentity is present and the stimulus is present in the first domaintransitioning to the second domain–then the method continues with step3645 (below). If the determination 3643 is negative, then the methodskips step 3645 and continues with step 3647 (below).

If the determination in step 3643 is positive, then a first response isexecuted 3645. A wide variety of first responses may be suitable for thepresent invention. For example, as described previously herein, anentity might be transferred between first and second domains. However,other responses might be equally suitable, including but not limited tochanges in the size, shape, visibility, content, color, etc. of theentity, changes to the first domain, second domain, and/or bridge,changes to the appearance of the environment overall, and/or changesinternal to a processor controlling the environment.

Continuing in FIG. 36 , a determination 3647 is made as to whether anentity is present (as identified in step 3631) and the stimulus ispresent in the second domain transitioning to the first domain (asidentified in step 3635). If the determination 364 is positive, then themethod continues with step 3649 (below). If the determination 3647 isnegative, then the method skips step 3649 and continues with step 3651(below).

If the determination in step 3647 is positive, then a first response isexecuted 3651. As noted previously with regard to first responses, awide variety of second responses may be suitable for the presentinvention. It is also emphasized that the second response will notnecessarily be the same as or even similar to the first response. Forexample, a first response might include transitioning an entity betweenfirst and second domains, while a second response determines whether ornot the entity is resolved.

Returning to FIG. 36 , a determination 3651 is made as to whether anentity is present (as identified in step 3631) and the stimulus ispresent solely in the first domain (as identified in step 3639). If thedetermination 3651 is positive, then the method continues with step 3653(below). If the determination 3651 is negative, then the method skipsstep 3653 and continues with step 3655 (below).

If the determination in step 3651 is positive, then a third response isexecuted 3651. As with the first and second responses, a wide variety ofthird responses may be suitable.

A determination 3655 is made as to whether an entity is present (asidentified in step 3631) and the stimulus is present solely in thesecond domain (as identified in step 3641). If the determination 3655 ispositive, then the method continues with step 3657 (below). If thedetermination 3655 is negative, then the method skips step 3657 andcontinues with step 3659 (below).

If the determination in step 3651 is positive, then a fourth response isexecuted 3651. As with the first, second, and third responses, a widevariety of fourth responses may be suitable.

At least a portion of the first domain is then outputted 3059.

In sum, the arrangement as shown in FIG. 36 facilitates selectivelyinvoking any of four responses with a single stimulus, depending on theconditions under which the stimulus is executed. For example, a singlegesture might selectively invoke any of four responses depending onwhether the gesture is executed in a first domain, in a second domain,beginning in a first domain and transitioning into a second domain, orbeginning in a second domain and transitioning into a first domain.Thus, where the gesture is executed may be used to determine and/orcontrol what the result the gesture produces (e.g. what command thegesture invokes).

An arrangement having first, second, third, and fourth responses asshown in FIG. 36 is an example only. It will be understood that fewerresponses may be suitable, if fewer conditions are considered. Forexample, consider an arrangement wherein steps 3633 and 3636 are removedfrom the method of FIG. 36 , so that the stimulus is only identified asbeing in the first domain 3639 or in the second domain 3641. Steps 3643and 3645 then also could be removed from consideration (absent astimulus in the first domain transitioning to the second domain asidentified in step 3633, the determination 3643 can never be positiveand the response 3645 will never be executed), and steps 3647 and 3649likewise could be removed. Such an arrangement would then result in astimulus being executed under two conditions, with two responses beingexecuted depending on the conditions under which the stimulus isexecuted.

An arrangement with three responses, or even with one response, likewisemay be equally suitable.

Similarly, an arrangement having more than the responses shown in FIG.36 also may be equally suitable. Such an arrangement might, for example,consider other options with regard to the stimulus, such as anarrangement wherein a stimulus initiates in a first domain, continues ina second domain, and then returns to the first domain and terminates inthe first domain. Features other than domain status likewise may beconsidered.

In addition, as has already been noted with regard to possible firstresponses for the example of FIG. 36 , not all first responses (orsecond responses, etc.) necessarily will directly affect or even requirethe presence of an entity. Thus, the arrangement as shown in FIG. 36might readily be modified so as to eliminate consideration of whether anentity is present altogether (i.e. removing step 3631), while yetremaining functional and within the scope of the present invention.Thus, the first, second, third, and or fourth responses might beselectively invoked with a single stimulus, regardless of the presenceor absence of one or more entities, with those responses potentiallybeing entirely unrelated to any entities that might or might not bepresent.

Moving on to FIG. 37 , as has also been described with respect to FIG.32 certain embodiments of the present invention may be executed as amachine-implemented method. For example, method steps may be executed ona data processor. In addition, a definitions may be loaded onto and/ordefined on a data processor, and/or executable instructions instantiatedthereon, so as to enable execution of method steps according to thepresent invention. FIG. 37 shows such an arrangement for a method atleast somewhat similar to that shown in FIG. 36 .

In FIG. 37 , in a processor, a first domain is defined 3761. A seconddomain distinct from the first domain also is defined 3763. A bridge isdefined 3765 so as to dispose the first and second domains incommunication by supporting transfer of entities therebetween. First andsecond domains and bridges according to the present invention have beendescribed previously herein.

A stimulus is defined 3767. Stimuli according to the present inventionalso have been previously described herein.

A first response to the stimulus is defined 3769. A second response tothe stimulus is also defined 3771. A third response to the stimulus isdefined 3773. A fourth response is defined 3775. Example responses suchas transfer of entities between first and second domains have beenpreviously described herein, though it is emphasized that the presentinvention is not limited only to responses relating to transfer ofentities between first and second domains.

Executable instructions are instantiated on the processor 3777 toidentify whether an entity is present.

Executable instructions are instantiated on the processor 3779 toidentify the presence of the stimulus initiating in the first domain andtransitioning to the second domain. Executable instructions areinstantiated on the processor 3781 to identify the presence of thestimulus initiating in the second domain and transitioning to the firstdomain. Executable instructions are instantiated on the processor 3783to identify the presence of the stimulus solely in the first domain.Executable instructions are instantiated on the processor 3785 toidentify the presence of the stimulus solely in the second domain.

Executable instructions are instantiated 3787 to execute the firstresponse. Executable instructions are instantiated 3789 to execute thesecond response. Executable instructions are instantiated 3796 toexecute the third response. Executable instructions are instantiated3797 to execute the fourth response.

Executable instructions are instantiated 3798 to output at least aportion of the first domain.

As with the method in FIG. 36 , with respect to FIG. 37 it will beunderstood that more or fewer than four responses may be utilizedthrough adding or removing appropriate definitions and/or executableinstructions while retaining the structure of the example as presentedin FIG. 37 .

The above specification, examples, and data provide a completedescription of the manufacture and use of the composition of theinvention. Since many embodiments of the invention can be made withoutdeparting from the spirit and scope of the invention, the inventionresides in the claims hereinafter appended.

1. A method comprising: sensing, by a sensor, an end-effector engagingwith an object located in a first domain; in response to the sensing ofthe end-effector engaging with the object in the first domain,transferring the object from the first domain to a second domain,wherein: the first domain is distinct from the second domain in at leastone dimension; and the object is transferred from the first domain tothe second domain through a bridge that links the first domain with thesecond domain, wherein the bridge comprises a positional aspect and avisual aspect; and in response to transferring the object from the firstdomain to the second domain, displaying, by a display, the object in thesecond domain.
 2. The method of claim 1, wherein the positional aspectof the bridge comprises the bridge being fixed relative to a field ofview of a user.
 3. The method of claim 1, wherein the positional aspectof the bridge comprises the bridge being repositionable within a fieldof view of a user.
 4. The method of claim 1, wherein the visual aspectof the bridge comprises the bridge being invisible to a user.
 5. Themethod of claim 1, wherein the visual aspect of the bridge comprises thebridge being visible to a user.
 6. The method of claim 1, wherein thepositional aspect of the bridge corresponds to a portion of an outeredge of a field of view of a user.
 7. The method of claim 1, wherein thepositional aspect of the bridge comprises the bridge corresponding withsubstantially all of an outer edge of a field of view of a user.
 8. Themethod of claim 1, wherein the positional aspect of the bridge comprisesthe bridge being responsive to a viewer command.
 9. A method,comprising: sensing, by a sensor, a first stimulus in a first domain;determining, by a processing device, that an object is in the firstdomain; in response to the sensing of the first stimulus in the firstdomain and determining the object in the first domain, transferring theobject from the first domain to a second domain via a bridge linking thefirst domain and the second domain, wherein: the bridge comprises apositional aspect and a visual aspect; and the first domain is distinctfrom the second domain in at least one dimension; and in response totransferring the object from the first domain to the second domain viathe bridge, displaying, by a display, at least a portion of the objectin the second domain.
 10. The method of claim 9, wherein: the firststimulus comprises movement of the end-effector along a first paththrough the bridge into the first domain from the second domain causingthe bridge to become visible; and the method further comprises, inresponse to sensing the end-effector passing through the bridge into thefirst domain from the second domain along a second path, causing thebridge to become visible and forgoing the transferring of the objectfrom the first domain to the second domain.
 11. The method of claim 9,wherein: the first stimulus comprises a first posture of an end-effectorpassing through the bridge into the first domain from the second domainto cause the bridge to become invisible; and the method furthercomprises, in response to sensing the end-effector passing through thebridge into the first domain from the second domain with a secondposture different from the first posture, causing the bridge to becomeinvisible and forgoing the transferring of the object from the firstdomain to the second domain.
 12. The method of claim 9, furthercomprising: in response to sensing of the second stimulus in the seconddomain and determining the object is in the second domain, transferringthe object from the second domain to the first domain via the bridge.13. The method of claim 12, further comprising displaying the object inthe first domain after transfer across the bridge at a portion of anedge of a field of view of a user.
 14. The method of claim 12, furthercomprising forgoing displaying the object in the first domain.
 15. Themethod of claim 12, further comprising displaying the object movingthrough space at an edge of a field of view of a user occupied by thebridge from the second domain into the first domain.
 16. The method ofclaim 12, wherein: the first domain corresponds to a first field of viewof a viewer oriented in a first direction; and in response to the viewerreorienting from the first direction to a second direction: moving thefirst domain in conjunction with the viewer reorienting from the firstdirection to the second direction; moving the second domain inconjunction with the viewer reorienting from the first direction to thesecond direction; and updating the positional aspect of the bridge inconjunction with the viewer reorienting from the first direction to thesecond direction.
 17. The method of claim 12, wherein: the first domainis at least a portion of a first field of view of a viewer; and inresponse to the viewer moving from a first location to a secondlocation: moving the first domain in conjunction with the viewer movingfrom the first location to the second location; moving the second domainin conjunction with the viewer moving from the first location to thesecond location; and updating the positional aspect of the bridge inconjunction with the viewer moving from the first location to the secondlocation.
 18. An apparatus comprising: a sensor configured to sense anend-effector in a first region of space or a second region of space,wherein: the first region of space is distinct from the second region ofspace; the first region of space and the second region of space areconnected via a bridge; one of the first region of space and the secondregion of space corresponds to a field of view of a user; and the otherof the first region of space and the second region of space is outsidethe field of view of the user; and a processor coupled to the sensor,wherein the processor is configured to: in response to the sensing ofthe end-effector in the first region of space and sensing an object inthe first region of space, transfer the object from the first region ofspace to the second region of space via a bridge having a positionalaspect and a visual aspect.
 19. The apparatus of claim 18, wherein theprocessor is further configured to communicate, to the user, thetransfer of the object from the first region of space to the secondregion of space via the bridge, wherein the positional aspect of thebridge is one of fixed or moveable and the visual aspect of the bridgeis one of visible or invisible.
 20. The apparatus of claim 18, whereinat least a portion of the first region of space spatially coincides withthe second region of space.